Senior Data Engineer | Databricks & Azure | Hybrid

TigerRisk Partners, LLC.; Greater London; Hybrid; GBP 70,000 - 110,000; Full time

Benefits offered by this job

Hybrid working

Job summary

Howden Group is expanding its data engineering capability and seeks a Senior Data Engineer with strong Databricks and Azure expertise to own metadata ingestion and orchestration initiatives. You will design scalable data pipelines, work with stakeholders to understand data needs, and guide junior engineers in a modern Azure-based data ecosystem.

The role offers hybrid working, autonomy, and opportunities to drive high-impact data initiatives across the business while advancing technical depth

Qualifications

• 4–6 years of data engineering experience focused on Databricks (SQL & PySpark).
• Hands-on with Azure data services including ADF, ADLS, and Azure Functions.
• Proven in metadata-driven data pipelines and orchestration.
• Strong CI/CD practices for data engineering and DevOps.

Responsibilities

• Own metadata ingestion frameworks and orchestration processes.
• Design scalable, reusable metadata-driven services to optimise pipelines.
• Build and maintain data solutions using Databricks and Azure services (ADF, ADLS, Functions).
• Collaborate with stakeholders to translate data needs into engineering solutions.
• Mentor junior engineers and review code to share best practices.
• Support data governance, security, and compliance efforts.

Skills

Databricks (SQL & PySpark)

Azure data services

Airflow

DBT

Spark Declarative Pipelines

CI/CD for data

Data governance & security

Insurance data experience

Tools

Azure Data Factory (ADF)

Azure Data Lake Storage (ADLS)

Azure Functions

Job description

Howden Group is expanding its data engineering capability and seeks a Senior Data Engineer with strong Databricks and Azure expertise to own metadata ingestion and orchestration initiatives. You will design scalable data pipelines, work with stakeholders to understand data needs, and guide junior engineers in a modern Azure-based data ecosystem.

The role offers hybrid working, autonomy, and opportunities to drive high-impact data initiatives across the business while advancing technical depth