Senior ML Systems Engineer, LLM Deployment

DeepMind Technologies Limited; Greater London; Hybrid; GBP 140,000 - 200,000; Full time

Job summary

Google DeepMind is seeking a Software Engineer to advance the deployment of large language models onto production infrastructure. You will collaborate with researchers and engineers to optimize serving, test agent systems, and build scalable inference backends.

The role involves working with cutting-edge AI, integrating ML workloads on GPUs/TPUs, and contributing to end-to-end AI deployment across multiple teams and projects.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8 years of software development experience.
• 2 years deploying and maintaining ML models in a live production environment.
• Experience with profiling, configuring, or executing ML workloads on hardware accelerators (GPU/TPU).
• Experience designing, building, or optimizing model serving infrastructure or inference backends.

Responsibilities

• Collaborate closely with Research teams to understand next generation modeling approaches, ensuring they are designed and implemented with production considerations in mind.
• Work with infrastructure teams to deliver serving infrastructure designed for maximum efficiency and performance, addressing bottlenecks in speed, scale, and quality.
• Identify opportunities to automate tasks, eliminate redundancies, build performant tests, and improve the overall velocity of model releases.
• Gain a deep understanding of serving frameworks, pre-processing pipelines, caching mechanisms, and other relevant technologies.
• Leverage roofline analysis, hardware-level profiling, and systems analysis to identify and eliminate performance bottlenecks across ML frameworks, compilers (XLA), custom kernels (Pallas), and serving infrastructure on hardware accelerators (TPUs/GPUs).

Skills

Software development

ML deployment

Model serving

Hardware accelerators

Education

Bachelor’s degree or equivalent practical experience

Tools

JAX

PyTorch

CUDA

OpenCL

XLA

Pallas

Job description

Google DeepMind is seeking a Software Engineer to advance the deployment of large language models onto production infrastructure. You will collaborate with researchers and engineers to optimize serving, test agent systems, and build scalable inference backends.

The role involves working with cutting-edge AI, integrating ML workloads on GPUs/TPUs, and contributing to end-to-end AI deployment across multiple teams and projects.