Cloud Data Engineering Lead — AI-Driven & Hybrid

Vanguard; Greater London; Hybrid; GBP 90,000 - 140,000; Full time

Benefits offered by this job

Hybrid work model

Office in London

Job summary

Vanguard Europe is hiring a Data Engineering Technical Lead to shape data products and analytics capabilities across business functions. You will lead a team in a cloud-first environment using Databricks, AWS, and IaC to deliver scalable, secure data solutions and influence engineering best practices.

You will work closely with Product Managers, Analysts, Architects, and stakeholders to translate complex requirements into robust data platforms and drive measurable business outcomes.

Qualifications

• Deep expertise designing and building scalable data pipelines in cloud environments.
• Strong hands-on experience with Databricks, Spark, SQL, and Python.
• Experience developing and optimizing batch and real-time data processing solutions.
• Understanding of modern data architecture patterns (Kimball, Data Vault, dimensional modelling).
• Experience implementing Infrastructure as Code (Terraform or CloudFormation).
• Experience leading technical delivery teams and mentoring engineers.

Responsibilities

• Write ETL processes; design databases; develop tools for real-time and offline analytics.
• Troubleshoot data pipelines to ensure data consistency and integrity across sources.
• Translate business specs into design and code; produce well-documented, maintainable software.
• Collaborate with product managers, analysts, architects, and stakeholders to implement data solutions.
• Lead all phases of solution development and explain technical concepts in meetings.
• Assess data quality and test code for accuracy; provide data analysis guidance.
• Mentor junior data engineers; contribute to engineering standards across Vanguard.
• Test and deploy new software releases; manage regression testing and production issues.
• Apply quality controls and evaluate vendor solutions to improve production systems.

Skills

Databricks

Spark

SQL

Python

Cloud architecture

Leadership

CI/CD

AI tooling

Tools

Terraform

CloudFormation

Git

Job description

Vanguard Europe is hiring a Data Engineering Technical Lead to shape data products and analytics capabilities across business functions. You will lead a team in a cloud-first environment using Databricks, AWS, and IaC to deliver scalable, secure data solutions and influence engineering best practices.

You will work closely with Product Managers, Analysts, Architects, and stakeholders to translate complex requirements into robust data platforms and drive measurable business outcomes.