Data Engineer II (Python/AWS) — Pipelines & Spark

JPMorgan Chase & Co.; Glasgow; On-site; GBP 65,000 - 90,000; Full time

Job summary

JPMorganChase in Glasgow is seeking a Software Engineer II to design, build, and operate secure, scalable data pipelines and services across AWS and cluster platforms. You will work on a high-performing agile team delivering production-ready data solutions that power critical business decisions.

You will develop Python-based data workflows, contribute to Databricks workloads, and ensure robust testing, security, and code quality with AI-assisted tooling across the SDLC.

Qualifications

• Formal training or certification on software engineering concepts.
• Hands-on experience in system design, application development, testing, and operational stability.
• Experience developing, debugging, and maintaining code in a large-scale environment using modern programming languages and database querying languages.
• Familiarity with Software Development Life Cycle practices, including exposure to agile methodologies, CI/CD pipelines, resiliency, and security principles.
• Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment with demonstrated ability to critically evaluate and validate AI-generated outputs.
• Understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations.

Responsibilities

• Design, build, and support ETL/ELT pipelines and data services on AWS, ensuring solutions are secure, stable, and scalable
• Develop and maintain data workflows using AWS Glue, including job authoring, data cataloging, and orchestration patterns
• Build and query data stores on Amazon Aurora PostgreSQL, applying sound data modelling principles and performance-aware SQL
• Contribute to Databricks workloads and integrations, supporting development-to-production practices across notebooks and jobs
• Write high-quality, secure code primarily in Python, with JavaScript where appropriate, and troubleshoot issues across upstream and downstream dependencies
• Leverage enterprise-authorized AI coding assist tools to improve code quality, delivery speed, and productivity, while validating outputs through peer review, automated testing, and secure coding standards
• Apply knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities
• Analyze large and diverse datasets to identify problems and contribute to decision-making that supports stable, high-quality application development
• Collaborate with technical and non-technical partners to communicate progress, surface risks, and deliver solutions with a secure-by-design mindset

Skills

Python programming

AWS cloud

SQL analytics

CI/CD

Agile methodologies

Secure coding

Tools

AWS Glue

Databricks

PostgreSQL

Amazon Aurora PostgreSQL

Job description

JPMorganChase in Glasgow is seeking a Software Engineer II to design, build, and operate secure, scalable data pipelines and services across AWS and cluster platforms. You will work on a high-performing agile team delivering production-ready data solutions that power critical business decisions.

You will develop Python-based data workflows, contribute to Databricks workloads, and ensure robust testing, security, and code quality with AI-assisted tooling across the SDLC.