Senior ML Inference & Model Serving Engineer

Google; Greater London; On-site; GBP 160,000 - 200,000; Full time

Benefits offered by this job

Learning opportunities

Career growth

Job summary

Google DeepMind is seeking a senior ML systems engineer to deploy and optimize large language models on Google's production infrastructure. You will work closely with research teams to design high-performance model serving solutions and drive efficiency across hardware accelerators.

The role focuses on profiling, tuning, and deploying models at scale with opportunities for IC and technical lead growth. London or Mountain View locations supported.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8 years of software development experience.
• 2 years deploying and maintaining ML models in production.
• Experience profiling ML workloads on GPUs or TPUs.
• Experience designing/optimizing model serving infrastructure.

Responsibilities

• Collaborate with research teams to understand production-friendly modeling approaches.
• Work with infrastructure teams to deliver efficient, high-performance serving infrastructure.
• Identify opportunities to automate tasks, remove redundancies, and improve ML release velocity.
• Gain deep understanding of serving frameworks, pre-processing pipelines, and caching mechanisms.
• Use roofline analysis and hardware profiling to address bottlenecks across ML stacks.

Skills

Software development

ML model deployment

Profiling on GPUs/TPUs

Model serving infrastructure

Collaboration with researchers

Education

Bachelor’s degree or equivalent practical experience

Tools

CUDA

PyTorch

Model serving frameworks

Job description

Google DeepMind is seeking a senior ML systems engineer to deploy and optimize large language models on Google's production infrastructure. You will work closely with research teams to design high-performance model serving solutions and drive efficiency across hardware accelerators.

The role focuses on profiling, tuning, and deploying models at scale with opportunities for IC and technical lead growth. London or Mountain View locations supported.