Lead Python PySpark Engineer — Scalable Data Platform

JPMorganChase; Glasgow; On-site; GBP 90,000 - 140,000; Full time

Job summary

JPMorganChase in Glasgow seeks a Lead Software Engineer to shape a trusted Global KYC and Risk Assessment Data Platform. You will lead across teams, define architecture and standards, and deliver secure, scalable software that supports multi-portfolio needs.

The role emphasizes collaboration with senior stakeholders, driving modern data engineering practices, and mentoring engineers to foster growth within a diverse team.

Qualifications

• Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale.
• Expertise in Python and/or PySpark.
• Advanced knowledge of software development with cloud, AI/ML, or data engineering.
• Experience with large-scale data processing, microservices, API design, Kafka, Redis, observability tools, and orchestration frameworks (Airflow, Temporal).
• Strong knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governance.
• Practical cloud-native experience (AWS, Azure, or GCP).
• Ability to present to senior leaders and foster inclusive teamwork.
• Strong problem-solving and analytical skills.
• Adaptability in a fast-paced environment.
• Focus on secure, scalable solutions.

Responsibilities

• Develop secure, high-quality production code for data-intensive applications and platforms.
• Review code and mentor engineers to foster growth and excellence.
• Create durable, reusable software frameworks and patterns for use across teams.
• Drive adoption of advanced technical methods and industry-standard practices.
• Advise cross-functional teams on technological matters within your domain.
• Apply knowledge of tools within the Software Development Life Cycle, including AI-assisted development and automation.
• Enhance automation at scale to improve value and efficiency.
• Lead architectural decisions and engineering practices across multiple teams.
• Collaborate with stakeholders to deliver impactful solutions.
• Champion best practices in software development and data engineering.
• Support a culture of innovation, inclusion, and continuous improvement.

Skills

Python

PySpark

Cloud

Data engineering

Kafka

Airflow

Databricks

Tools

Databricks

Snowflake

Spark

Airflow

Temporal

AWS

Azure

GCP

Job description

JPMorganChase in Glasgow seeks a Lead Software Engineer to shape a trusted Global KYC and Risk Assessment Data Platform. You will lead across teams, define architecture and standards, and deliver secure, scalable software that supports multi-portfolio needs.

The role emphasizes collaboration with senior stakeholders, driving modern data engineering practices, and mentoring engineers to foster growth within a diverse team.