Data engineer databricks

Add Agility; Southampton; Hybrid; GBP 83,000 - 113,000; Full time

Benefits offered by this job

Hybrid work pattern

Job summary

Add Agility in London seeks a hands-on Databricks and data engineering professional to extract data from Azure DevOps, transform it, and deliver robust data models for dashboards. You will ingest data, build reusable datasets, and define meaningful engineering metrics.

The role involves collaboration with product and client teams and offers a hybrid London work pattern. The project runs five days per week through Christmas 2026 with two days in London and three days remote, paying £530 per day

Qualifications

• Hands-on data engineering experience with Databricks.
• Strong knowledge of Azure DevOps data and APIs.
• Ability to build robust ingestion pipelines and data models.

Responsibilities

• Extracting data from Azure DevOps.
• Building robust ingestion pipelines into Databricks.
• Transforming Azure DevOps work-items and historical data.
• Creating clean, reusable datasets for reporting and analytics.
• Developing calculations for engineering and delivery metrics.
• Building data models and tables for dashboard consumption.
• Improving data quality, validation and monitoring.
• Collaborating with stakeholders to turn metrics into data products.

Skills

Databricks

Azure DevOps

Data pipelines

Data modeling

SQL

Tools

Azure DevOps APIs

Analytics data

Job description

Location: Hybrid – 2 days per week in London, 3 days remote

Requirements : Have the right to work in the uk.

Rate: £530 per day

IR35: Outside IR35

Duration: Until Christmas 2026

Commitment: 5 days per week

Location: Hybrid – 2 days per week in London, 3 days remote

Requirements : Have the right to work in the uk.

The Role

The core challenge is to extract data from Azure DevOps, transform it in Databricks and create reliable, reusable datasets that can power a comprehensive metrics dashboard across a large number of technology teams.

You will be working for Add Agility a consultancy that solves problems for clients and working with one or more of our clients based in central London

This is primarily a Databricks and data engineering role . With some The wider environment also includes Palantir Foundry data visualisation. , but deep Palantir expertise is not required. Other members of the team can support with Palantir-specific elements.

What You'll Be Doing

• Extracting data from Azure DevOps
• Working with Azure DevOps APIs and/or Analytics data
• Building robust ingestion pipelines into Databricks
• Understanding and transforming Azure DevOps work-item and historical data
• Creating clean, reusable datasets for reporting and analytics
• Building calculations for engineering and delivery metrics.
• Creating reliable data models and tables that can be consumed by the dashboard layer
• Improving data quality, validation and monitoring
• Working alongside product, engineering and client stakeholders to turn metric definitions into working data products
• Creating components and approaches that can be reused across future implementations

This is a hands-on engineering role . We need someone who can understand the underlying Azure DevOps data, build the pipelines and transformations, and turn it into a robust data layer from which meaningful engineering metrics can be calculated.

The initial engagement runs five days per week until Christmas 2026 , with two days per week working with the team in London and three days remote.

£530/day – Outside IR35.