Data Engineering Lead: Cloud Pipelines & AI-Driven Analytics

The Vanguard Group

Greater London

Hybrid

GBP 110,000 - 150,000

Full time

6 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Hybrid work model
In-office 3 days a week (Tue-Thu)

Job summary

The Vanguard Group in the United Kingdom seeks a Data Engineering Technical Lead to shape and deliver data and analytics capabilities. You will lead the technical design, development, and evolution of data products, working with Databricks, AWS, and IaC, while guiding a team of engineers and partnering with product managers and stakeholders.

You will build scalable, secure data solutions, promote AI-enabled software development, and drive engineering best practices across Vanguard's global team.

Qualifications

  • Experience designing scalable data pipelines and data products in cloud environments.
  • Strong hands-on experience with Databricks, Spark, SQL, and Python.
  • Experience implementing Infrastructure as Code using Terraform or CloudFormation.

Responsibilities

  • Write ETL processes and design databases for real-time and offline analytics.
  • Lead the development of data products to support business decisions across functions.
  • Mentor and educate junior data engineers and lead technical delivery teams.
  • Collaborate with Product Managers, Data Analysts, Architects and stakeholders to translate requirements into design.

Skills

Databricks
Spark
SQL
Python
Infra as Code
Terraform
CloudFormation
Lead teams
Stakeholder mgmt
Data governance
CI/CD
Agile
AI tooling

Tools

Git
GitHub Copilot

Job description

The Vanguard Group in the United Kingdom seeks a Data Engineering Technical Lead to shape and deliver data and analytics capabilities. You will lead the technical design, development, and evolution of data products, working with Databricks, AWS, and IaC, while guiding a team of engineers and partnering with product managers and stakeholders.

You will build scalable, secure data solutions, promote AI-enabled software development, and drive engineering best practices across Vanguard's global team.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Data Engineering Lead - Cloud Pipelines & AI
Data Engineering Lead - Cloud Pipelines & AI

Vanguard • United Kingdom

Hybrid
GBP 90,000 - 130,000
Hybrid work 3 days/week
Cloud Data Engineering Lead — AI-Driven & Hybrid
Cloud Data Engineering Lead — AI-Driven & Hybrid

Vanguard • Greater London

Hybrid
GBP 90,000 - 140,000
Hybrid work model
Office in London
Data Engineering Technical Lead
Data Engineering Technical Lead

Vanguard • Greater London

Hybrid
GBP 90,000 - 140,000
Hybrid work model
Office in London
Data Engineering Technical Lead
Data Engineering Technical Lead

Vanguard • United Kingdom

Hybrid
GBP 90,000 - 130,000
Hybrid work 3 days/week
Databricks Data Engineer - Cloud Pipelines Lead (Hybrid UK)
Databricks Data Engineer - Cloud Pipelines Lead (Hybrid UK)

Venturi • England

Hybrid
GBP 48,000 - 80,000
Private medical insurance
Employer pension contribution
Life assurance
+3
Lead Data Engineer — AI-Driven Data & Analytics (Python/Databricks)
Lead Data Engineer — AI-Driven Data & Analytics (Python/Databricks)

J.P. MORGAN • Scotland

On-site
GBP 90,000 - 120,000
Data Engineering Technical Lead
Data Engineering Technical Lead

The Vanguard Group • Greater London

On-site
GBP 110,000 - 150,000
Hybrid work model
In-office 3 days a week (Tue-Thu)
Senior Data Engineer — AI-Powered Data Pipelines in the Cloud
Senior Data Engineer — AI-Powered Data Pipelines in the Cloud

Transform • Greater London

On-site
GBP 75,000 - 110,000
Holiday entitlement
Birthday day off
Pension eligibility (matched)
+4
Azure Databricks Data Platform Architect & Tech Lead
Azure Databricks Data Platform Architect & Tech Lead

EPAM Systems, Inc. • City of Westminster

On-site
GBP 90,000 - 120,000
Data Engineering Manager: Lead Scalable AI & Analytics Pipelines
Data Engineering Manager: Lead Scalable AI & Analytics Pipelines

PwC UK • Manchester

On-site
GBP 70,000 - 100,000
Private medical cover
Flexible working
Volunteer days