Senior Python Data Engineer - Databricks

Next Frontier Capital; Glasgow; On-site; GBP 90,000 - 130,000; Full time

Job summary

JPMorganChase is seeking an experienced Software Engineer III within Investment Banking Data Products to design and deliver data collection, storage, access, and analytics solutions that are secure, stable, and scalable.

You will develop, test, and maintain essential data pipelines and architectures to support various business functions, collaborating with engineers to drive innovation and a culture of excellence, collaboration, and continuous improvement.

Qualifications

• Formal training or certification on software engineering concepts.
• Good working knowledge of cloud-based data services (especially Glue jobs and Federated Data Lake), unified analytics platforms, and Python.
• Experience across the data lifecycle, including ingestion, transformation, storage, and access patterns.
• Advanced proficiency in SQL, including joins and aggregations, with a working understanding of NoSQL databases.
• Significant experience with statistical data analysis and the ability to determine appropriate tools and data patterns for analysis.
• Experience utilizing cloud services for developing, deploying, and managing applications at scale.
• Good understanding and working knowledge of software development lifecycle tools used for configuration management, continuous integration and delivery pipelines, unit testing, regression testing, and performance testing.
• Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment with demonstrated ability to critically evaluate and validate AI-generated outputs.
• Understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations.

Responsibilities

• Develop workflows and extract, load, and transform pipelines using Python and Databricks to support scalable and reliable data solutions.
• Support the review of controls to ensure sufficient protection of enterprise data across the data lifecycle.
• Implement data security using entitlements frameworks to safeguard sensitive information.
• Update logical and physical data models based on evolving business use cases and requirements.
• Apply SQL expertise — including complex joins and aggregations — and leverage NoSQL databases to support diverse data access patterns.
• Apply reuse-first, AI-assisted practices to strengthen software development lifecycle quality routines for data pipelines, ensuring traceability and secure coding standards.
• Leverages enterprise-authorized AI coding assist tools to improve code quality and delivery speed, with peer review and automated testing.

Skills

Python

Databricks

SQL

NoSQL

Cloud data services

Data security

AI-assisted development tools

Data pipelines

Data governance

Cloud-based analytics

Architectural design

Education

Software engineering training/certification

Tools

Databricks tools

Job description

JPMorganChase is seeking an experienced Software Engineer III within Investment Banking Data Products to design and deliver data collection, storage, access, and analytics solutions that are secure, stable, and scalable.

You will develop, test, and maintain essential data pipelines and architectures to support various business functions, collaborating with engineers to drive innovation and a culture of excellence, collaboration, and continuous improvement.