Lead Data Engineer: Python, Databricks, AWS

JPMorgan Chase & Co.; Auchentibber; On-site; GBP 60,000 - 80,000; Full time

Job summary

JPMorgan Chase & Co. is looking for a Lead Software Engineer to join their External Regulatory Financial Control team in Glasgow. This role focuses on developing and maintaining scalable data processing solutions using technologies like Python and Databricks, while collaborating with cross-functional teams.

The ideal candidate will have experience in data management, ETL pipeline development, and proficiency in SQL, Python, and AWS. A strong problem-solving ability and knowledge of the financial services industry are essential.

Qualifications

• Proven experience in data management and large-scale data processing.
• Proficiency in SQL, Python, and PySpark, with query optimization.
• Hands-on experience with data lake platforms and AWS cloud services.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and Databricks.
• Execute creative, data-driven software solutions and troubleshoot issues.
• Lead and participate in the full Software Development Life Cycle (SDLC).

Skills

SQL

Python

PySpark

Data management

AWS

Data quality and lineage

CI/CD

Agile methodologies

Data lake platforms

Problem-solving

Tools

Databricks

Apache Spark

Airflow

Job description

JPMorgan Chase & Co. is looking for a Lead Software Engineer to join their External Regulatory Financial Control team in Glasgow. This role focuses on developing and maintaining scalable data processing solutions using technologies like Python and Databricks, while collaborating with cross-functional teams.

The ideal candidate will have experience in data management, ETL pipeline development, and proficiency in SQL, Python, and AWS. A strong problem-solving ability and knowledge of the financial services industry are essential.