Lead Data Engineer — Scale the Data Stack (Hybrid London)

La Fosse; Greater London; Hybrid; GBP 100,000 - 120,000; Full time

Job summary

A leading tech firm in Greater London is seeking a Lead Data Engineer to shape and scale its data function. In this pivotal role, you will lead a team of engineers, design and optimize data pipelines, and develop cloud-native solutions using AWS. The ideal candidate will have strong experience with Python, Airflow, and API development. This position allows for hybrid working, combining office presence in London three days a week with remote collaboration.

Qualifications

• Strong hands-on experience with AWS (Azure or GCP also considered).
• Excellent programming skills in Python.
• Proven background in API development.

Responsibilities

• Lead and mentor a small team of data engineers.
• Design, build and optimise data pipelines using Python and Airflow.
• Develop scalable, cloud-native solutions on AWS.
• Build and maintain robust APIs and streaming pipelines.
• Partner closely with analytics, product, and engineering teams.

Skills

AWS

Python

API development

Airflow

Snowflake

Kubernetes

Terraform

Kafka

Job description

A leading tech firm in Greater London is seeking a Lead Data Engineer to shape and scale its data function. In this pivotal role, you will lead a team of engineers, design and optimize data pipelines, and develop cloud-native solutions using AWS. The ideal candidate will have strong experience with Python, Airflow, and API development. This position allows for hybrid working, combining office presence in London three days a week with remote collaboration.