Senior Lead Data Engineer: Big Data & Cloud Analytics

JPMorgan Chase & Co.; Greater London; On-site; GBP 110,000 - 150,000; Full time

Job summary

JPMorgan Chase & Co. in London seeks a Senior Lead Software Engineer to build and operate scalable data and analytics services powering markets risk decisions.

You will lead delivery across ingestion, transformation, storage and consumption layers, and mentor engineers while driving reliability and governance across Databricks and Amazon Redshift. In this senior hands-on role, you will define data products, workflows, and ongoing operational excellence, with a focus on performance, cost control,

Qualifications

• Experience delivering production software systems at scale.
• Proficiency in Python and or Java or Scala, with CS fundamentals.
• Hands-on experience with distributed data processing and building data pipelines.
• Experience with Databricks, Redshift, or equivalent platforms.
• Proficiency in SQL and data modeling concepts.
• Cloud engineering concepts including security, networking, IAM, encryption, observability.
• Troubleshooting production issues and improving operations.
• Strong communication with distributed teams.

Responsibilities

• Lead end-to-end delivery of complex initiatives across ingestion, transformation, storage and consumption layers.
• Promote engineering best practices including design/code reviews, testing standards, CI/CD, and documentation.
• Mentor engineers and raise the bar on technical quality and operational excellence.
• Design and build robust batch and streaming pipelines for high-volume workloads.
• Optimize data models, partitioning, and performance tuning for large datasets.
• Create reusable data-frameworks to accelerate onboarding of new datasets and analytics use cases.
• Design data products across Databricks and Redshift including ingestion, transformations, and serving layers.
• Contribute to reconciliation, lineage and controls across data warehouses.

Skills

Production software

Python/Java/Scala

Distributed data processing

Databricks

Amazon Redshift

SQL

Cloud engineering

Troubleshooting

Communication

Tools

Databricks

Amazon Redshift

Spark

Job description

JPMorgan Chase & Co. in London seeks a Senior Lead Software Engineer to build and operate scalable data and analytics services powering markets risk decisions.

You will lead delivery across ingestion, transformation, storage and consumption layers, and mentor engineers while driving reliability and governance across Databricks and Amazon Redshift. In this senior hands-on role, you will define data products, workflows, and ongoing operational excellence, with a focus on performance, cost control,