Lead Infra Engineer - Market Data (AWS + Snowflake)

Next Frontier Capital; Greater London; On-site; GBP 90,000 - 130,000; Full time

Job summary

J.P. Morgan is seeking a Lead Engineer in Market Data Services to design, deliver, and maintain data distribution systems across on-prem and cloud.

You will work in an Agile environment with cross-functional teams, shaping data solutions for multiple lines of business. Responsibilities include building real-time and historical data pipelines, validating AI-driven recommendations, and ensuring resiliency, security, and auditability in data handling.

Qualifications

• Formal training or certification on infrastructure engineering concepts and advanced applied experience in Cloud technologies including Kubernetes, Terraform and AWS.
• Data Lake technologies (e.g. Snowflake, Databricks, AWS Glue/Athena, Lake Formation)
• Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support infrastructure engineering workflows with strong validation habits and awareness of data sensitivity.
• Ability to review and validate AI-assisted recommendations before implementation, escalating when uncertain and ensuring outcomes align to resiliency, security, and auditability expectations

Responsibilities

• Applies deep technical expertise and problem-solving methodologies focused on analyzing complex data and systems, anticipating issues, considering upstream and downstream implications, and advising on mitigation actions
• Uses enterprise-authorized AI capabilities within the work environment to accelerate analysis of complex infrastructure signals and documentation of mitigation options, validating outputs and handling operational data according to sensitivity and security requirements
• Designing and maintaining critical data delivery systems - encompassing both realtime data, historical data and AI/ML use-cases
• Collaboration with product owners and stakeholders to ensure data solutions align with business and regulatory requirements
• Capable of finding a balance between best of breed and cost effective solutions
• Act as a positive team player who is capable of accepting different intellectual points of view
• Clear and concise communicator; ability to present to senior management
• Ability to analyze and articulate problems and provide input into solutions
• Provide 3rd level support to operational roles
• A respect for strong process and control management disciplines
• Leads reuse-first adoption of AI-assisted practices across delivery and automation routines to reduce recurring issues, ensuring changes are validated, traceable and auditable, and aligned to resiliency and security expectations.

Skills

Kubernetes

Terraform

AWS

Java

Python

C++

Tools

ITRS Geneos

Dynatrace

Datadog

Job description

J.P. Morgan is seeking a Lead Engineer in Market Data Services to design, deliver, and maintain data distribution systems across on-prem and cloud.

You will work in an Agile environment with cross-functional teams, shaping data solutions for multiple lines of business. Responsibilities include building real-time and historical data pipelines, validating AI-driven recommendations, and ensuring resiliency, security, and auditability in data handling.