Lead Python PySpark Engineer for Scalable Data Platform

JPMorgan Chase & Co.; Glasgow; On-site; GBP 90,000 - 140,000; Full time

Job summary

JPMorgan Chase & Co. in the Corporate Sector’s agile data engineering team is seeking a Lead Software Engineer to promote the development of a trusted Global KYC and Risk Assessment Data Platform.

You will lead across multiple teams, define architecture and engineering standards, and deliver scalable software that helps millions of customers. You will collaborate with colleagues to implement secure, stable solutions, mentor engineers, and shape the team’s culture and technical direction while

Qualifications

• System design and end-to-end application development at enterprise scale.
• Proficiency in Python and PySpark.
• Cloud, AI/ML, or data engineering depth.
• Experience with large-scale data processing, microservices, APIs.
• Familiarity with Kafka, Redis, Dynatrace/Splunk/Grafana, Airflow/Temporal.
• Cloud-native experience across AWS, Azure, or GCP.

Responsibilities

• Develop secure, high-quality production code for data-intensive applications.
• Review code and mentor engineers to foster growth.
• Create durable, reusable software frameworks and patterns across teams.
• Drive adoption of advanced technical methods and industry-standard practices.
• Advise cross-functional teams on technological matters within your domain.
• Apply knowledge of tools within the Software Development Life Cycle, including AI-assisted development and automation.
• Enhance automation at scale to improve value and efficiency.
• Lead architectural decisions and engineering practices across multiple teams.
• Collaborate with stakeholders to deliver impactful solutions.
• Champion best practices in software development and data engineering.
• Support a culture of innovation, inclusion, and continuous improvement.

Skills

Python / PySpark

Data engineering

Cloud platforms (AWS/Azure/GCP)

Kafka / Redis / Memcached

Airflow / Temporal

Databricks / Snowflake

Spark / PySpark

Apache Iceberg

LLM orchestration

Vector stores / data lakes

Tools

Kafka

Redis

Memcached

Dynatrace

Splunk

Grafana

Airflow

Temporal

Databricks

Snowflake

Apache Iceberg

AWS Bedrock

Azure OpenAI

Job description

JPMorgan Chase & Co. in the Corporate Sector’s agile data engineering team is seeking a Lead Software Engineer to promote the development of a trusted Global KYC and Risk Assessment Data Platform.

You will lead across multiple teams, define architecture and engineering standards, and deliver scalable software that helps millions of customers. You will collaborate with colleagues to implement secure, stable solutions, mentor engineers, and shape the team’s culture and technical direction while