Software Engineer II – Data Pipelines on AWS (Python)

Aumni; Glasgow; On-site; GBP 70,000 - 90,000; Full time

Job summary

J.P. Morgan is seeking a Software Engineer II in Glasgow to design, build, and operate secure, scalable data pipelines and services across AWS and cluster platforms.

You will contribute to a high-performing agile team delivering production-ready solutions and deepen expertise across the modern data engineering stack. You will code primarily in Python with JavaScript where needed, work with AWS Glue, PostgreSQL, and Databricks, and apply responsible AI practices to ensure secure, resilient data

Qualifications

• Formal training or certification on software engineering concepts and expanding applied experience.
• Hands-on experience in system design, application development, testing, and operational stability.
• Experience developing, debugging, and maintaining code in a large-scale environment using modern programming languages and database querying languages.
• Familiarity with Software Development Life Cycle practices, including exposure to agile methodologies, CI/CD pipelines, resiliency, and security principles.
• Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment with demonstrated ability to critically evaluate and validate AI-generated outputs.
• Understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations.

Responsibilities

• Design, build, and support ETL/ELT pipelines and data services on AWS, ensuring solutions are secure, stable, and scalable.
• Develop and maintain data workflows using AWS Glue, including job authoring, data cataloging, and orchestration patterns.
• Build and query data stores on Amazon Aurora PostgreSQL, applying sound data modelling principles and performance-aware SQL.
• Contribute to Databricks workloads and integrations, supporting development-to-production practices across notebooks and jobs.
• Write high-quality, secure code primarily in Python, with JavaScript where appropriate, and troubleshoot issues across upstream and downstream dependencies.
• Leverage enterprise-authorized AI coding assist tools to improve code quality, delivery speed, and productivity, while validating outputs through peer review, automated testing, and secure coding standards.
• Apply knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
• Analyze large and diverse datasets to identify problems and contribute to decision-making that supports stable, high-quality application development.
• Collaborate with technical and non-technical partners to communicate progress, surface risks, and deliver solutions with a secure-by-design mindset.

Skills

Python

JavaScript

AWS

Databricks

SQL

PostgreSQL

PySpark

CI/CD

AI-assisted tooling

Tools

AWS Glue

Databricks

PostgreSQL

Job description

J.P. Morgan is seeking a Software Engineer II in Glasgow to design, build, and operate secure, scalable data pipelines and services across AWS and cluster platforms.

You will contribute to a high-performing agile team delivering production-ready solutions and deepen expertise across the modern data engineering stack. You will code primarily in Python with JavaScript where needed, work with AWS Glue, PostgreSQL, and Databricks, and apply responsible AI practices to ensure secure, resilient data