Lead Data Platform Engineer

JP Morgan Chase; Greater London; On-site; GBP 62,000 - 102,000; Full time

Job summary

JP Morgan Chase in London is seeking a Lead Data Engineer to design and scale cloud-native data platforms. You will own data pipelines, collaborate with analysts and data scientists, and drive best practices in reliability, security, and performance.

The role requires 8+ years coding as a data engineer, strong Python, SQL, and experience with AWS/GCP/Azure, Redshift, Snowflake, Spark, Airflow, and Kubernetes. You will mentor juniors and help shape platform standards across the team.

Qualifications

• Degree in Computer Science or STEM, or equivalent
• 8+ years hands-on data engineer experience
• Strong Python, unit/integration testing
• Experience delivering in agile, fast-paced environments
• Cloud data platforms with AWS/GCP/Azure
• Large-scale distributed data processing expertise
• Experience with Redshift, BigQuery or Snowflake
• Spark, Flink or Trino; Iceberg/Hudi or similar
• SQL skills and dbt
• Airflow or similar orchestration
• Kafka or similar messaging
• AI capabilities usage with validation and data sensitivity awareness
• Data modeling for analytics
• Security, risk, governance for data platforms
• CI/CD for data/platform services
• Docker/Kubernetes

Responsibilities

• Design scalable data processing and data quality frameworks with Python, PySpark, and dbt
• Build and optimize batch and streaming pipelines with performance and observability
• Operate Apache Airflow workflows for data movement and transformations
• Model and transform data for analytics using SQL and dbt
• Write production-grade Python and PySpark with tests and OO design
• Implement Terraform to provision cloud components
• Containerize and deploy with Docker/Kubernetes and Helm
• Collaborate with analysts and data scientists to translate requirements into designs
• Own critical data systems, improving reliability, scalability, security
• Mentor junior engineers and shape technical direction
• Use enterprise AI capabilities to accelerate data platform work while ensuring data sensitivity

Skills

Python

SQL

Unit testing

Agile

Data modeling

Cloud data platforms

System design

Hands-on coding

Education

Degree in Computer Science or STEM

Tools

AWS

Google Cloud

Azure

Redshift

BigQuery

Snowflake

Spark

Flink

Trino

Iceberg

Hudi

dbt

Airflow

Kafka

Docker

Kubernetes

Terraform

Job description

JP Morgan Chase in London is seeking a Lead Data Engineer to design and scale cloud-native data platforms. You will own data pipelines, collaborate with analysts and data scientists, and drive best practices in reliability, security, and performance.

The role requires 8+ years coding as a data engineer, strong Python, SQL, and experience with AWS/GCP/Azure, Redshift, Snowflake, Spark, Airflow, and Kubernetes. You will mentor juniors and help shape platform standards across the team.