Senior Data Engineer — Databricks on Azure (Hybrid/Flexible)

Howden Group; England; Hybrid; GBP 75,000 - 110,000; Full time

Job summary

Howden Group Services is seeking a Senior Data Engineer to own high-impact data initiatives in a modern Azure-based data ecosystem. You will design and deliver metadata-driven data solutions using Databricks, Azure Data Factory, ADLS, and related services, with autonomy and collaboration across stakeholders.

The role focuses on building scalable pipelines, guiding junior engineers, and implementing best practices in CI/CD and data governance to enable business insights and operational

Qualifications

• 4-6 years of experience in data engineering with a focus on Databricks (SQL & PySpark).
• Hands-on with Azure data services (ADF, ADLS, Azure Functions).
• Experience designing metadata-driven data pipelines.
• Understanding of orchestration and data workflow automation (Airflow, DBT, Spark Declarative Pipelines).
• Knowledge of CI/CD practices for data engineering and data governance.

Responsibilities

• Own metadata ingestion frameworks and orchestration processes.
• Design scalable, metadata-driven data services to optimise data pipelines.
• Build and maintain data solutions using Databricks and Azure services.
• Apply best practices for CI/CD and DevOps for data.
• Collaborate with stakeholders, data scientists, and analysts to translate needs.
• Optimize pipelines for performance, reliability, and scalability.
• Mentor junior engineers and review code.

Skills

Databricks (SQL & PySpark)

Azure data services

CI/CD for data

Data governance & security

Stakeholder collaboration

Tools

Airflow

DBT

Spark Declarative Pipelines

Azure Data Factory

Azure Functions

ADLS

Job description

Howden Group Services is seeking a Senior Data Engineer to own high-impact data initiatives in a modern Azure-based data ecosystem. You will design and deliver metadata-driven data solutions using Databricks, Azure Data Factory, ADLS, and related services, with autonomy and collaboration across stakeholders.

The role focuses on building scalable pipelines, guiding junior engineers, and implementing best practices in CI/CD and data governance to enable business insights and operational