Lead AI Infrastructure Engineer

Hackajob Ltd; Paisley; On-site; GBP 120,000 - 180,000; Full time

Job summary

JPMorgan Chase is seeking a Lead Software Engineer for the AI and Machine Learning Platform team to design and operate scalable AI infrastructure. You will own reliability, performance, and cost-efficiency of the LLM inference platform end-to-end, deploying on Amazon EKS, SageMaker, and on-prem GPU clusters with strong observability.

You will lead incident response, capacity planning, and continuous improvement while collaborating across engineering to deliver secure software and robust

Qualifications

• Formal training, certification, or equivalent practical experience in software engineering concepts.
• Hands-on experience with system design, application development, testing, and operational stability in production environments.
• Hands-on production experience operating LLM inference servers and related tooling.

Responsibilities

• Design, develop, troubleshoot, and deliver secure, high-quality production software and services for AI infrastructure.
• Build backend services and APIs that enable reliable operation of AI infrastructure in production.
• Operate and scale LLM serving infrastructure and model hosting on cloud and on-prem clusters.

Skills

Python

AWS

Kubernetes

Terraform

Site reliability engineering

Observability

Incident management

Tools

Terraform

AWS

Kubernetes

Job description

JPMorgan Chase is seeking a Lead Software Engineer for the AI and Machine Learning Platform team to design and operate scalable AI infrastructure. You will own reliability, performance, and cost-efficiency of the LLM inference platform end-to-end, deploying on Amazon EKS, SageMaker, and on-prem GPU clusters with strong observability.

You will lead incident response, capacity planning, and continuous improvement while collaborating across engineering to deliver secure software and robust