Senior Data Engineer — AI-Driven Data Platform Lead (Hybrid)

Remote Worker LTD.; Greater London; Hybrid; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Hybrid working model

25 days annual leave

Cycle to work scheme

Private medical insurance

Job summary

Zoopla is seeking a Senior Data Engineer to build the next stage of our data platform in a hybrid London-based role. You will own data engineering projects end to end, design and migrate pipelines to standard patterns, and build governance into every pipeline while applying AI to accelerate delivery.

You will collaborate with platform engineers and Data Engineering peers to align systems and enable ambitious choices for the data-driven business.

Qualifications

• Substantial experience building and running production data pipelines that other teams and customers depend on.
• Strong Python and SQL expertise demonstrated in production environments.
• Deep experience with a modern lakehouse, ideally Databricks and Unity Catalog, and with dbt.
• Comfortable on AWS and with infrastructure as code (Terraform).
• Strong grounding in ingestion and integration patterns: managed connectors, change data capture, event-driven and streaming ingestion, and exports to external systems and customers.
• A track record of simplifying: replacing one-off pipelines with a small number of patterns, without breaking things on the way.
• Experience using AI tools in engineering work, with a clear view on where they help, and how to keep them safe.
• Practical data governance: access control, data quality and personal data handling, applied so teams can move faster.
• You can explain technical things in plain English, and you push back when the ask doesn't match the problem.

Responsibilities

• Owning Data Engineering projects end to end, from technical direction to business impact.
• Designing and building our standard ingestion and export patterns, and moving existing pipelines onto them.
• Building governance into every pipeline: access, personal data, lineage and cost.
• Using AI to make the patterns faster to apply, and helping bring Data Engineering into our software factory.
• Reviewing code, mentoring other engineers, and sharing knowledge.
• Taking your share of keeping production healthy.

Skills

Python

SQL

Databricks

Unity Catalog

dbt

AWS

Terraform

Data governance

AI in engineering

Code review

Tools

Terraform

Fivetran

Auto Loader

Delta Sharing

Unity Catalog

Job description

Zoopla is seeking a Senior Data Engineer to build the next stage of our data platform in a hybrid London-based role. You will own data engineering projects end to end, design and migrate pipelines to standard patterns, and build governance into every pipeline while applying AI to accelerate delivery.

You will collaborate with platform engineers and Data Engineering peers to align systems and enable ambitious choices for the data-driven business.