Lead Data Engineer: AI-Driven Data Pipelines & Platforms

And Digital

Birmingham

On-site

GBP 90,000 - 130,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

25 days bookable holiday + flexible BH
Pension: 6% + 2% employee
Aviva healthcare cover
Flexibenefit: £1000 to tailor benefits
Life Assurance
Income Protection
Eye test + first pair of glasses
Parental Benefits: Enhanced Leave

Job summary

AND Digital is seeking a Lead Data Engineer to design and operate scalable data platforms for multi‑million user organisations. You’ll lead hands‑on data pipelines, collaborate with cross‑functional teams, and champion DataOps in production environments.

You’ll bring strong SQL, Snowflake/Databricks experience, cloud skills (AWS/Azure/GCP), and a Data Product mindset, with pragmatic use of AI tools to accelerate delivery.

Qualifications

  • Develop pipelines that bring data to life for decision making.
  • Hands-on data with quality, flow and information organisation.
  • Experience with SQL and orchestration tools to produce production-grade pipelines.
  • Snowflake and/or Databricks experience with relevant certifications desirable.
  • Experience with at least one cloud platform (AWS, Azure or GCP) and related services.
  • Hands-on DataOps: CI/CD, version control, IaC.
  • Data Product mindset: datasets discoverable, addressable, trustworthy.
  • Bridge between engineering and business value; translate needs into specs.
  • Experience using AI to augment delivery; know when to trust it.

Responsibilities

  • Develop pipelines that brings data to life for decision making, either delivering insight or for more sophisticated data science applications
  • Be comfortable working in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data platforms into large organisations.
  • Hands-on data engineering with SQL and orchestration tools to develop production-grade pipelines.
  • Work with Snowflake and/or Databricks and related cloud services.
  • Adopt a Data Product mindset and ensure datasets are discoverable and trustworthy.
  • Translate stakeholder needs into robust data product specifications.
  • Apply AI to augment delivery with prudent judgement.

Skills

SQL
dbt
Airflow
Prefect
Dagster
Snowflake
Databricks
AWS
Azure
GCP
CI/CD
Version control
IaC
Data product
AI-assisted

Tools

dbt
Airflow
Dagster
Snowflake
Databricks
AWS
Azure
GCP

Job description

AND Digital is seeking a Lead Data Engineer to design and operate scalable data platforms for multi‑million user organisations. You’ll lead hands‑on data pipelines, collaborate with cross‑functional teams, and champion DataOps in production environments.

You’ll bring strong SQL, Snowflake/Databricks experience, cloud skills (AWS/Azure/GCP), and a Data Product mindset, with pragmatic use of AI tools to accelerate delivery.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer — AI Data Platform & Pipelines
Lead Data Engineer — AI Data Platform & Pipelines

Resume Skip • Greater London

On-site
GBP 90,000 - 130,000
Unlimited leaves
Life insurance & private health
No hierarchy
+1
Lead Data Engineer: Build & Scale AI Data Pipelines
Lead Data Engineer: Build & Scale AI Data Pipelines

Datatech Analytics • City Of London

On-site
GBP 81,000 - 99,000
Lead Data Engineer | AI-Driven Cloud Data Solutions
Lead Data Engineer | AI-Driven Cloud Data Solutions

Answer Digital Limited. • Leeds

Hybrid
GBP 80,000 - 100,000
Competitive salary
Flexible annual leave
Bonus based on company performance
+5
Lead Data Engineer: Architect AI‑Driven Data Platforms
Lead Data Engineer: Architect AI‑Driven Data Platforms

DataTruth Ltd • Greater London

Hybrid
GBP 90,000 - 150,000
25 days leave
London hybrid
MacBook Pro
+1
Lead Data Engineer
Lead Data Engineer

Lorien • England

On-site
GBP 90,000 - 120,000
Data Platform Engineer for Scalable AI Pipelines
Data Platform Engineer for Scalable AI Pipelines

Global Media Group Services • Greater London

On-site
GBP 65,000 - 90,000
Lead Data Engineer: Build Scalable Data Platforms & Pipelines
Lead Data Engineer: Build Scalable Data Platforms & Pipelines

Sahaj Software • Greater London

On-site
GBP 90,000 - 120,000
Unlimited leaves
Life insurance
Private health insurance
+2
Data Engineer: Scale AI-Driven Data Pipelines
Data Engineer: Scale AI-Driven Data Pipelines

Global • Greater London

On-site
GBP 70,000 - 110,000
Lead Data Engineer, AI & Data Pipelines Architect
Lead Data Engineer, AI & Data Pipelines Architect

Latentbridge • Greater London

On-site
GBP 90,000 - 140,000
Data Engineering Lead: AI-Driven Platforms & Leadership
Data Engineering Lead: AI-Driven Platforms & Leadership

NewDay • Greater London

Hybrid
GBP 90,000 - 140,000