Lead Data Engineer

La Fosse; Greater London; Hybrid; GBP 100,000 - 120,000; Full time

Job summary

A leading tech firm in Greater London is seeking a Lead Data Engineer to shape and scale its data function. In this pivotal role, you will lead a team of engineers, design and optimize data pipelines, and develop cloud-native solutions using AWS. The ideal candidate will have strong experience with Python, Airflow, and API development. This position allows for hybrid working, combining office presence in London three days a week with remote collaboration.

Qualifications

• Strong hands-on experience with AWS (Azure or GCP also considered).
• Excellent programming skills in Python.
• Proven background in API development.

Responsibilities

• Lead and mentor a small team of data engineers.
• Design, build and optimise data pipelines using Python and Airflow.
• Develop scalable, cloud-native solutions on AWS.
• Build and maintain robust APIs and streaming pipelines.
• Partner closely with analytics, product, and engineering teams.

Skills

AWS

Python

API development

Airflow

Snowflake

Kubernetes

Terraform

Kafka

Job description

Job Description

Lead Data Engineer

Salary : £100,000 – £120,000 per annum

Location : Hybrid – 3 days per week in the London office

About the role

We are working with a fast-growing, product-driven SaaS start-up looking for a Lead Data Engineer to help shape and scale the data function. This is an excellent opportunity for a Senior or Principal Data Engineer ready to step into a leadership role and drive technical direction across a modern data stack.

Responsibilities

• Lead and mentor a small team of data engineers.
• Design, build and optimise data pipelines and integrations using Python and Airflow.
• Develop scalable, cloud-native solutions on AWS, leveraging services such as Snowflake, Kubernetes, and Terraform for infrastructure-as-code.
• Build and maintain robust APIs and streaming pipelines (Kafka) to support real-time and batch data needs.
• Partner closely with analytics, product, and engineering teams to ensure data is accurate, reliable, and driving business value.

Requirements

• Strong hands-on experience with AWS (Azure or GCP also considered).
• Excellent programming skills in Python .
• Proven background in API developme...