Lead Python/PySpark Data Engineer — KYC Platform

Next Frontier Capital; Glasgow; On-site; GBP 90,000 - 135,000; Full time

Job summary

JPMorgan Chase in the United Kingdom is seeking a Lead Software Engineer to advance a trusted Global KYC and Risk Assessment Data Platform within an agile Data Engineering team. You will guide architecture, set engineering standards, and deliver secure, scalable software across multiple squads.

You will mentor engineers, drive modern data processing practices, and collaborate with senior stakeholders to shape technical direction and outcomes.

Qualifications

• Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale.
• Expertise in Python and/or PySpark.
• Advanced knowledge of cloud, AI/ML, or data engineering.
• Experience with large-scale data processing, microservices, API design, Kafka, Redis/MemCached, and observability tools.
• Cloud-native experience (AWS, Azure or GCP).
• Strong communication with senior leaders and executives.
• Commitment to inclusive, collaborative teamwork.
• Adaptability in a fast-paced environment.
• Focus on delivering secure and scalable solutions.

Responsibilities

• Develop secure, high-quality production code for data-intensive applications and platforms.
• Review code and mentor engineers to foster growth and excellence.
• Create durable, reusable software frameworks and patterns for use across teams.
• Drive adoption of advanced technical methods and industry-standard practices.
• Advise cross-functional teams on technological matters within your domain.
• Apply knowledge of SDLC tools, including AI-assisted development and automation.
• Enhance automation at scale to improve value and efficiency.
• Lead architectural decisions and engineering practices across multiple teams.
• Collaborate with stakeholders to deliver impactful solutions.
• Champion best practices in software development and data engineering.
• Support a culture of innovation, inclusion, and continuous improvement.

Skills

Python

PySpark

Cloud skills

Data engineering

Kafka

APIs

Observability tools

Airflow/Temporal

Databases - relational & NoSQL

Tools

Databricks

Snowflake

Kubernetes

CI/CD

Job description

JPMorgan Chase in the United Kingdom is seeking a Lead Software Engineer to advance a trusted Global KYC and Risk Assessment Data Platform within an agile Data Engineering team. You will guide architecture, set engineering standards, and deliver secure, scalable software across multiple squads.

You will mentor engineers, drive modern data processing practices, and collaborate with senior stakeholders to shape technical direction and outcomes.