Lead Data Engineer - Python, Databricks & AWS

JPMorgan Chase & Co.; Glasgow; On-site; GBP 90,000 - 125,000; Full time

Job summary

JPMorgan Chase & Co. is seeking a Lead Software Engineer to design, develop and maintain scalable data processing solutions in a cloud-first environment.

You will work across teams to transform financial data into actionable insights using Databricks, Python and AWS. Responsibilities include building robust data pipelines, modeling data for analytics, ensuring data quality and governance, and supporting modernization of legacy systems to cloud-based warehouses.

Qualifications

• Proven experience in data management and large-scale data processing.

Responsibilities

• Execute data-driven software solutions, including design, development and troubleshooting.
• Design, develop and maintain scalable data pipelines using Python, PySpark, SQL and Databricks on AWS.
• Develop data models for reporting and analytics.
• Ensure data quality, security and lineage throughout processing.

Skills

SQL

Python

PySpark

Databricks

AWS

CI/CD

SRE

Data Modeling

Data Warehousing

Airflow

Tools

Databricks

Apache Spark

AWS

Job description

JPMorgan Chase & Co. is seeking a Lead Software Engineer to design, develop and maintain scalable data processing solutions in a cloud-first environment.

You will work across teams to transform financial data into actionable insights using Databricks, Python and AWS. Responsibilities include building robust data pipelines, modeling data for analytics, ensuring data quality and governance, and supporting modernization of legacy systems to cloud-based warehouses.