Azure Databricks Data Engineer - OUTSIDE IR35

TN United Kingdom; London; Hybrid; GBP 150,000 - 200,000; Full time

Job summary

An established industry player is seeking a talented Data Engineer to join their dynamic team. This role offers the opportunity to work with cutting-edge technologies in a hybrid environment, blending remote work with in-office collaboration in London. The ideal candidate will have a strong background in Data Engineering, particularly with Databricks and Spark, and a solid understanding of data governance principles. If you have a passion for driving data solutions and thrive in a fast-paced environment, this position is perfect for you.

Qualifications

• Experience in Capital Markets or Banking is a must.
• Ownership and ability to drive implementation and solution design.

Responsibilities

• Develop and maintain data pipelines using Databricks and Spark.
• Implement data governance and quality measures.

Skills

Data Engineering in Databricks

Spark programming with Scala

Spark programming with Python

SQL

Delta Lake

Azure Data Lake

Data Governance

Data Modelling concepts

Unity Catalog

Data Architecture

Tools

MS Purview

Collibra

Informatica Data Quality

Job description

Social network you want to login/join with:

Client:

Location:

London, United Kingdom

Job Category:

-

EU work permit required:

Yes

Job Reference:

2de9bf904b9f

Job Views:

3

Posted:

08.05.2025

Expiry Date:

22.06.2025

Job Description:

Day Rate: £450 - £550 P/ day
Location: Hybrid (Remote / 2 Days a week in London)
Start: Immediate Start
Note: Capital Markets, or at least Banking experience is a MUST!

Key expertise and experience we're looking for:

• Data Engineering in Databricks
• Spark programming with Scala, Python, SQL
• Experience with Delta Lake is preferred
• Databricks workflows, jobs, etc.
• Familiarity with Azure Data Lake: data ingestion and ETL/ELT frameworks
• Data Governance: Metadata, Data Quality, Lineage, Data Access Models
• Understanding of Data Modelling concepts, Data Products, and Data Domains
• Unity Catalog experience is a key differentiator; if not, experience with similar Catalog/Data Governance tools
• MS Purview or similar tools (Collibra, Informatica Data Quality/MDM/Axon) experience is a plus
• Data Architecture experience is a bonus
• Skills in Python, Scala, Databricks Spark, and Pyspark for Data Engineering
• Ownership and ability to drive implementation and solution design

For more information, please contact Ellis via email directly to @