Senior GPU Performance Engineer for AI/ML & HPC

Google; Greater London; On-site; GBP 120,000 - 180,000; Full time

Job summary

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. This role sits on the ML-Omega team, optimizing GPU systems for diverse ML workloads and benchmarking for Google’s internal workloads.

We strive for maximum efficiency and scalable performance, and seek engineers who can contribute across the full stack while collaborating with product teams such as DeepMind to tackle ML model

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 5 years of software development experience.
• 5 years of data structures and algorithms experience.
• 5 years of ML/AI/NLP experience.
• 3 years of software testing/maintenance/launching; 1 year of design/architecture experience.

Responsibilities

• Identify and maintain Large Language Model (LLM) training and serving benchmarks that are representative of Google production, industry, and the ML community, using them to identify performance opportunities, drive Accelerated Linear Algebra (XLA) GPU/Triton performance, and guide XLA releases.
• Engage with Google product teams like DeepMind to solve their ML model performance problems, such as onboarding new LLM models and products on GPU hardware and enabling LLMs to train and serve efficiently at a very large scale.
• Run architecture-level simulations on GPU designs and perform roofline analysis to guide internal teams.
• Analyze performance and efficiency metrics to identify bottlenecks, as well as design and implement solutions at Google fleet-wide scale.
• Run performance benchmarks on GPU hardware using internal and external tools.

Skills

Software development

Data structures & algorithms

Machine learning

Software testing

Software architecture

Technical leadership

Hardware co-design

High-performance computing

GPU programming

Compiler optimizations

Education

Bachelor’s degree

Master’s or PhD preferred

Tools

CUDA

Triton kernels

XLA

Compiler design tools

Job description

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. This role sits on the ML-Omega team, optimizing GPU systems for diverse ML workloads and benchmarking for Google’s internal workloads.

We strive for maximum efficiency and scalable performance, and seek engineers who can contribute across the full stack while collaborating with product teams such as DeepMind to tackle ML model