Data Engineer III: Databricks, Python & AWS Expert

Testing Site - JPMC; Scotland; On-site; GBP 65,000 - 95,000; Full time

Job summary

JPMorganChase in the United Kingdom (Scotland) is seeking a Data Engineer III to design, develop, and maintain scalable data pipelines using Python/PySpark on Databricks and AWS. You will work with cross-functional teams to deliver high-quality data infrastructure that supports analytics and regulatory reporting.

The role emphasizes data quality, performance tuning, and full SDLC involvement, including production support and SRE responsibilities, with opportunities to leverage AI tools for rapid

Qualifications

• Strong hands-on data engineering experience
• Proficient in Python and PySpark for large-scale data processing
• Experience with Databricks and Spark ecosystem
• SQL skills with query optimization
• Experience with AWS services (S3, Lambda, etc.)
• Experience with SDLC, CI/CD tools, Agile methodologies
• Bachelor's degree in Computer Science, Engineering, Math, or related field

Responsibilities

• Design, develop, and maintain scalable data pipelines
• Process and transform large financial datasets for analytics and reporting
• Optimize queries and workflows for performance at scale
• Analyze data outputs to identify quality issues and bottlenecks
• Participate in the full SDLC including design, testing, deployment, maintenance
• Implement data quality checks, monitoring, and alerting
• Collaborate with Product Owners and end users to support business use cases
• Act as Production Support and SRE for the Data Engineer role
• Utilize AI tools to build and test data pipelines

Skills

Python

PySpark

Databricks

SQL

AWS

SDLC

Jenkins

Spinnaker

Sonar

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks platform

Apache Spark

Airflow

Step Functions

Jenkins

Job description

JPMorganChase in the United Kingdom (Scotland) is seeking a Data Engineer III to design, develop, and maintain scalable data pipelines using Python/PySpark on Databricks and AWS. You will work with cross-functional teams to deliver high-quality data infrastructure that supports analytics and regulatory reporting.

The role emphasizes data quality, performance tuning, and full SDLC involvement, including production support and SRE responsibilities, with opportunities to leverage AI tools for rapid