Senior Lead Software Engineer, Big Data & Cloud Engineering — Risk Central (London)

JPMorganChase; Greater London; On-site; GBP 120,000 - 180,000; Full time

Job summary

JPMorgan Chase in London seeks a Senior Lead Software Engineer to lead large-scale data and analytics initiatives across a modern cloud and big data stack. You will partner with Front Office, Risk, Product Control, and Finance to deliver timely, high-quality analytics and govern enterprise data platforms including Databricks and Redshift.

You will mentor engineers, drive best practices, and own end-to-end delivery from ingestion to consumption, with a strong focus on reliability and performance

Qualifications

• Proven experience delivering production software systems at scale.
• Strong coding skills in Python/Java/Scala and CS fundamentals.
• Hands-on with distributed data processing (Spark) and building batch/streaming pipelines.
• Experience with Databricks, Redshift or similar data warehouses/lakehouses.
• Proficient SQL; solid data modeling and analytics understanding.
• Cloud engineering basics: security, networking, IAM, encryption, observability.
• Proven ability to troubleshoot production issues and drive improvements.
• Excellent communication and collaboration with globally distributed teams.

Responsibilities

• Lead end-to-end delivery across ingestion, transformation, storage, and consumption layers.
• Drive engineering best practices: design/code reviews, testing standards, CI/CD, and documentation.
• Mentor engineers and raise the bar on quality, ownership, and operational excellence.
• Design and build robust batch and streaming pipelines for high-volume workloads.
• Implement data modeling, partitioning, and performance tuning for large datasets.
• Build reusable frameworks to accelerate onboarding of new datasets and analytics use cases.
• Engineer data products and workflows spanning Databricks and Redshift, including ingestion and serving layers.
• Define approaches to reconciliation, lineage, controls, and governance across warehouses.
• Optimize query performance and cost; establish workload placement best practices.
• Build cloud-native solutions on AWS (S3, EMR, Lambda, Kinesis/MSK, Glue, etc.).
• Own production stability with monitoring, incident management, root-cause analysis, and SLAs/SLOs.

Skills

Python/Java/Scala

Distributed processing

Data pipelines

SQL proficiency

Cloud engineering

Operational excellence

Mentoring

Tools

Databricks

Amazon Redshift

Spark

Kafka

MSK

Kinesis

CI/CD

Terraform

Job description

Job Description

Build and operate data and analytics services that power critical markets risk decisions at scale. In this senior, hands-on role, you will lead complex engineering initiatives across a modern cloud and big data stack while shaping technical direction and standards. You will partner closely with stakeholders across Front Office, Risk, Product Control, and Finance to deliver timely, consistent, high-quality analytics. You will help strengthen reliability, governance, and performance across enterprise data platforms, including Databricks and Amazon Redshift. As a Senior Lead Software Engineer at JPMorgan Chase in the Risk Central team, you will be a senior hands-on engineer and technical leader responsible for building and operating scalable data and analytics services supporting Markets risk use cases. You will lead delivery across ingestion, transformation, storage, and consumption layers, with a strong focus on operational excellence and predictable outcomes. You will design and evolve data products and workflows that run across Databricks and Amazon Redshift, improving consistency, controls, and performance. You will mentor engineers, drive engineering best practices, and communicate clearly on progress, risks, dependencies, and trade-offs.

Job Responsibilities

• Lead end-to-end delivery of complex initiatives across ingestion, transformation, storage, and consumption layers.
• Drive engineering best practices including design reviews, code reviews, testing standards, CI/CD, and documentation.
• Mentor engineers and raise the bar on technical quality, ownership, and operational excellence.
• Design and build robust batch and streaming pipelines using distributed compute for high-volume workloads.
• Implement efficient data modeling, partitioning, and performance tuning strategies for large datasets.
• Build reusable frameworks and components to accelerate onboarding of new datasets and analytics use cases.
• Engineer data products and workflows spanning Databricks and Amazon Redshift, including ingestion patterns, transformations, and serving layers.
• Define approaches to reconciliation, consistency, lineage, and controls across both enterprise data warehouses.
• Optimize query performance and cost across platforms, and establish best practices for workload placement.
• Build cloud-native solutions on AWS aligned to team standards, including services such as S3, EMR, Lambda, Kinesis or MSK, Glue, EventBridge, DynamoDB, Redshift, and EKS.
• Own production stability by improving monitoring and alerting, incident management, root-cause analysis, preventative engineering, and SLAs and SLOs.

Required Qualifications, Capabilities, And Skills

• Demonstrated experience delivering production software systems at scale.
• Proficiency in Python and or Java or Scala, with computer science fundamentals including data structures, algorithms, and object-oriented design.
• Hands-on experience with distributed data processing, such as Spark, and building data pipelines in batch and or streaming patterns.
• Experience with Databricks, Amazon Redshift, or equivalent enterprise data warehouse and lakehouse platforms, including designing and tuning performant workloads.
• Proficiency in SQL and understanding of data modeling and analytics patterns.
• Practical knowledge of cloud engineering concepts, including security, networking basics, IAM and access controls, encryption, and observability.
• Proven ability to troubleshoot production issues and drive operational improvements.
• Strong communication skills and experience working with globally distributed teams.

Preferred Qualifications, Capabilities, And Skills

• Experience in Markets technology, including familiarity with the trade lifecycle, market risk measures, sensitivities, and P&L explain, plus common products such as FX, rates, credit, and equities.
• Experience with streaming technologies and near-real-time analytics patterns, including Kafka, MSK, or Kinesis.
• Experience with governance, controls, and data quality frameworks including reconciliations, lineage, auditability, and entitlements.
• Familiarity with lake and lakehouse table formats and concepts, including Iceberg or Delta, and columnar storage formats such as Parquet.
• Experience with CI/CD, infrastructure as code, containerized workloads, and DevOps practices.
• Experience leading initiatives across multiple teams, including technical leadership, mentoring, and cross-team coordination.

Risk Central is a strategic technology group within JPMorganChase's Commercial and Investment Bank that builds and operates a next-generation analytics platform used for critical front office and risk reporting. The platform delivers timely, consistent, and high-quality data and analytics to support risk management and decision-making across global markets. A key aspect of the role is operating across two enterprise data warehouses, Databricks and Amazon Redshift, ensuring data consistency, performance, governance, and reliability across both platforms. The role is aligned to the Risk Central team in London.

About Us

J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations, governments, wealthy individuals and institutional investors. Our first-class business in a first-class way approach to serving clients drives everything we do. We strive to build trusted, long-term partnerships to help our clients achieve their business objectives. We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

About The Team

J.P. Morgan's Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world.