Databricks Data Engineer - Capital Markets

Robert Walters UK; London; Hybrid; GBP 100,000 - 125,000; Full time

Job summary

An established industry player is seeking a skilled Databricks Data Engineer for a contract role that promises exciting challenges and impactful projects. In this dynamic environment, you will leverage your expertise in data engineering, particularly with Databricks and Spark, to contribute to significant projects within the financial services sector. This role offers a hybrid work setup, allowing flexibility while you engage in data modeling and governance tasks. If you're ready to take your career to the next level and make a real difference, this opportunity is perfect for you.

Qualifications

• Strong experience in Data Engineering using Databricks and Spark.
• Familiarity with Azure Data Lake and data governance practices.

Responsibilities

• Work on impactful data engineering projects in a hybrid environment.
• Utilize skills in data modeling and governance for financial services.

Skills

Data Engineering in Databricks

Spark programming with Scala

Spark programming with Python

Spark programming with SQL

Delta Lake

Databricks workflows

Azure Data Lake

Data Governance

Data Modelling concepts

Unity Catalog

MS Purview

Capital Markets experience

Data Architecture

Job description

Looking for an exciting contract opportunity as a Databricks Data Engineer? Work on impactful projects in a dynamic environment, utilizing your skills in data modeling and Capital Markets or Banking experience. Ready for your next challenge?

Key expertise and experience we’re looking for:

• Data Engineering in Databricks
• Spark programming with Scala, Python, SQL
• Ideally experience with Delta Lake
• Databricks workflows, jobs, etc.
• Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks
• Data Governance experience – Metadata, Data Quality, Lineage, Data Access Models
• Good understanding of Data Modelling concepts, Data Products and Data Domains
• Unity Catalog experience is a key differentiator – if not then experience with a similar Catalog/Data Governance Management component
• MS Purview (Metadata and Data Quality tool) experience is a bonus – experience in similar tools is valuable (Collibra, Informatica Data Quality/MDM/Axon etc.)
• Ideally Capital Markets, or at least Banking experience
• Data Architecture experience is a bonus

Contract Details:

Type: Contract
Rate: £700-750 - LTD Company
IR35: OUTSIDE
Duration: 6-12 months initially
Location: London
Hybrid: Yes

Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates.

About the job

Contract Type: CONTRACTOR
Focus: Data Science & AI Research
Workplace Type: Hybrid
Experience Level: Associate
Location: City of London
Specialism: Technology & Digital
Industry: Financial Services
Salary: £500 - £700 per day

Job Reference: LBAXJB-85CA3616

Date posted: 21 March 2025

Consultant: Dane Moore