Databricks Data Engineer: Lakehouse & Ingestion Pro

OpenTalent; England; On-site; GBP 54,000 - 94,000; Full time

Job summary

OpenTalent in the United Kingdom is seeking a data engineer with strong Databricks and data ingestion experience to join our team. The role focuses on building scalable pipelines and integrating data from cloud sources across platforms.

The ideal candidate has hands-on experience with Azure Data Factory, Databricks Lakeflow, SQL, Python and dbt, plus familiarity with Medallion Architecture and API integrations. Immediate start preferred; ability to begin within 1–2 weeks is a plus.

Qualifications

• Strong commercial Databricks experience.
• Proven data ingestion experience.
• Experience with Azure Data Factory.
• Experience with Databricks Lakeflow.
• Strong SQL and API integration skills.
• Experience with Medallion Architecture.
• Strong Python skills.
• Experience with dbt.
• Experience with incremental and batch data ingestion.

Responsibilities

• Build and maintain data ingestion pipelines.
• Collaborate with analytics teams to understand data needs.
• Optimize data quality and performance.

Skills

Databricks

Data ingestion

SQL

Python

API integration

Medallion Architecture

Databricks Lakeflow

Incremental ingestion

Batch ingestion

Tools

Azure Data Factory

dbt

Job description

OpenTalent in the United Kingdom is seeking a data engineer with strong Databricks and data ingestion experience to join our team. The role focuses on building scalable pipelines and integrating data from cloud sources across platforms.

The ideal candidate has hands-on experience with Azure Data Factory, Databricks Lakeflow, SQL, Python and dbt, plus familiarity with Medallion Architecture and API integrations. Immediate start preferred; ability to begin within 1–2 weeks is a plus.