Senior Data Engineer - AI-Driven Pipelines on Databricks

Zoopla; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Hybrid work arrangement

25 days annual leave

Cycle to work

Private medical insurance

Group income protection

Gym on-site

Pension plan

Discretionary annual bonus up to 10%

Job summary

Zoopla seeks a Senior Data Engineer to build the next stage of our data platform in London. You will own end-to-end data pipelines, design ingestion/export patterns, and ensure governance and cost controls.

You’ll work with Databricks on AWS, dbt, and Fivetran, leveraging Terraform and AI tools to accelerate delivery while keeping safety in mind. Hybrid working with in-office collaboration at Tower Bridge.

Qualifications

• Substantial experience building production data pipelines relied on by multiple teams.
• Strong Python and SQL proficiency.
• Deep experience with a modern lakehouse (Databricks) and dbt.
• Comfortable on AWS and infrastructure as code (Terraform).
• Experience with ingestion patterns: managed connectors, CDC, streaming ingestion, and exports to external systems.
• Track record of simplifying pipelines to a small set of patterns without breaking existing flows.
• Experience using AI tools in engineering with safety considerations.
• Practical data governance: access control, data quality, and personal data handling.

Responsibilities

• Own data engineering projects end to end from technical direction to business impact.
• Design and migrate ingestion and export patterns; standardise pipelines.
• Embed governance into pipelines for access, data quality and cost transparency.
• Leverage AI to accelerate pattern application and integrate into the software factory.
• Review code, mentor engineers and share knowledge.
• Maintain production health and reliability.

Skills

Python

SQL

Databricks

Unity Catalog

dbt

AWS

Terraform

Data ingestion

Data governance

AI tools in engineering

Tools

Fivetran

RudderStack

Delta Sharing

Databricks Lakeflow

Auto Loader

Job description

Zoopla seeks a Senior Data Engineer to build the next stage of our data platform in London. You will own end-to-end data pipelines, design ingestion/export patterns, and ensure governance and cost controls.

You’ll work with Databricks on AWS, dbt, and Fivetran, leveraging Terraform and AI tools to accelerate delivery while keeping safety in mind. Hybrid working with in-office collaboration at Tower Bridge.