Data Engineer III - Python, Databricks & AWS

J.P. Morgan; Glasgow; On-site; GBP 60,000 - 80,000; Full time

Job summary

A global financial services firm in Glasgow is seeking a PySpark/AWS Data Engineer III to design and deliver cloud technology products. You will be responsible for producing high-quality code and analyzing large data sets to improve software systems. The ideal candidate has over 3 years of experience in system design and is proficient in Python and cloud technologies. This role emphasizes agile methodologies and offers an opportunity to work with leading technologies in a collaborative environment.

Qualifications

• 3+ years of experience in system design, application development, and operational stability.
• Proficient in coding with Python, PySpark, or Databricks.
• Experience with both relational and NoSQL databases.

Responsibilities

• Design and deliver cloud technology products.
• Create secure and high-quality production code.
• Analyze and develop reporting from large data sets.

Skills

Python

PySpark

Databricks

Relational databases

NoSQL databases

Agile methodologies

Tools

AWS

EC2

EKS

Lambdas

Job description

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a PySpark/AWS Data Engineer III at JPMorgan Chase within the Payments Technology Regulatory Reporting team, you serve as a seasoned member of an agile team to design and deliver trusted market‑leading cloud technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives.

Job responsibilities

• Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
• Creates secure and high‑quality production code and maintains algorithms that run synchronously with appropriate systems
• Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
• Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems
• Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture
• Contributes to software engineering communities of practice and events that explore new and emerging technologies
• Adds to team culture of diversity, opportunity, inclusion, and respect

Required qualifications, capabilities, and skills

• 3+ years hands‑on practical experience in system design, application development, testing, and operational stability
• Hands‑on practical experience in system design, application development, testing, and operational stability
• Proficient in coding in one or more data engineering languages/platforms – Python / PySpark / Databricks or similar
• Working experience with both relational and NoSQL databases
• Experience and proficiency across the data lifecycle
• Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages
• Overall knowledge of the Software Development Life Cycle
• Solid understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
• Demonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)

Preferred qualifications, capabilities, and skills

• Exposure to cloud technologies Databricks, AWS MSK, EC2, EKS, S3, RDS, Lambdas
• Exposure to payment domain streaming systems
• Exposure to payment regulatory reporting