Databricks Data Engineer: Ingestion & Pipelines on Azure

OpenTalent; Hounslow; On-site; GBP 70,000 - 110,000; Full time

Job summary

OpenTalent in the United Kingdom is seeking a data engineer with Databricks expertise to design and maintain robust data ingestion pipelines. You will work with Azure Data Factory, Databricks Lakeflow, SQL, Python, and dbt to deliver reliable, scalable data solutions.

Immediate availability or a 1–2 week start is preferred, with a focus on delivering end-to-end ingestion architectures within a fast-paced environment.

Qualifications

• Databricks experience required with hands-on data ingestion.
• Experience with Azure Data Factory and Databricks Lakeflow.
• Strong SQL and API integration skills.
• Proficiency in Python and dbt.
• Experience with incremental and batch data ingestion.
• Immediate availability or start within 1–2 weeks.

Responsibilities

• Build and maintain data ingestion pipelines using Databricks and related tooling.

Skills

Databricks experience

Data ingestion experience

Azure Data Factory

Databricks Lakeflow

SQL proficiency

API integration

Python

dbt

Incremental ingestion

Job description

OpenTalent in the United Kingdom is seeking a data engineer with Databricks expertise to design and maintain robust data ingestion pipelines. You will work with Azure Data Factory, Databricks Lakeflow, SQL, Python, and dbt to deliver reliable, scalable data solutions.

Immediate availability or a 1–2 week start is preferred, with a focus on delivering end-to-end ingestion architectures within a fast-paced environment.