Senior AI Platform Lead - LLM Inference & Kubernetes

JPMorgan Chase & Co.; Glasgow; On-site; GBP 90,000 - 150,000; Full time

Job summary

JPMorgan Chase & Co. is seeking a Senior Lead Software Engineer in Corporate Technology – AI, ML and Data Platform in Glasgow. You will lead design and delivery of secure, scalable platform capabilities, focusing on production‑grade LLM inference and Kubernetes‑based deployment patterns.

You will mentor engineers and drive reliable, standards‑driven automation across teams. You will collaborate with multiple engineering groups to improve reliability, developer experience, and operational

Qualifications

• Hands-on experience building standards and tooling to improve platform adoption.
• Deep hands-on experience with large language model inference systems in production.
• Hands-on experience deploying production services on AWS.
• Ability to design, deploy and troubleshoot cloud infrastructure components in AWS.

Responsibilities

• Lead design and delivery of platform standards and tooling to simplify adoption and day‑to‑day use.
• Operate production large language model inference services using modern serving engines.
• Drive Kubernetes deployment patterns, scaling strategies and reliability practices.
• Optimize inference performance by understanding GPU memory behavior and cache sizing.
• Evaluate inference-time quantization trade-offs affecting latency and throughput.
• Implement secure, high-quality production code and automation to strengthen resiliency and observability.
• Maintain architecture/design artifacts enforcing non-functional requirements via automation.
• Promote enterprise AI-assisted engineering practices and standardized reviews and tests.
• Utilize SDLC tools and AI-assisted development capabilities to improve automation value.

Skills

LLM inference systems

Kubernetes

AWS cloud

GPU memory optimization

Quantization techniques

CI/CD and security

Secure production code

Automation and standards

AI-assisted development tools

Observability and resiliency

Tools

vLLM

TensorRT-LLM

SGLang

LLM-D

Job description

JPMorgan Chase & Co. is seeking a Senior Lead Software Engineer in Corporate Technology – AI, ML and Data Platform in Glasgow. You will lead design and delivery of secure, scalable platform capabilities, focusing on production‑grade LLM inference and Kubernetes‑based deployment patterns.

You will mentor engineers and drive reliable, standards‑driven automation across teams. You will collaborate with multiple engineering groups to improve reliability, developer experience, and operational