Senior GPU AI/ML Performance Engineer

Google LLC; Greater London; On-site; GBP 90,000 - 150,000; Full time

Job summary

Google LLC is seeking a Senior GPU Performance Software Engineer, AI/ML, to join the ML-Omega team in London. You will help optimize, model, and evaluate GPU systems for benchmarking Google's internal ML workloads and for guiding future Cloud hardware decisions.

The role requires deep experience with ML algorithms, GPU programming, performance analysis, and collaboration with product teams to solve large-scale model performance challenges.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 5 years of software development experience in one or more languages.
• 5 years of data structures and algorithms experience.
• 5 years of ML algorithms/tools, AI, DL, or NLP experience.
• 3 years testing/maintaining/launching software products and 1 year in design/architecture.

Responsibilities

• Identify and maintain LLM benchmarks representative of Google production, industry, and the ML community, using them to identify performance opportunities, drive Accelerated Linear Algebra (XLA) GPU/Triton performance, and guide XLA releases.
• Engage with Google product teams like DeepMind to solve ML model performance problems, onboarding new LLM models and products on GPU hardware and enabling LLMs to train and serve efficiently at a very large scale.
• Run architecture-level simulations on GPU designs and perform roofline analysis to guide internal teams.
• Analyze performance and efficiency metrics to identify bottlenecks, as well as design and implement solutions at Google fleet-wide scale.
• Run performance benchmarks on GPU hardware using internal and external tools.

Skills

Software development

Data structures & algorithms

Machine learning algorithms

Software design & architecture

Education

Bachelor's degree or equivalent practical experience

Tools

CUDA

Triton kernels

Palace/Mosaic kernels

Job description

Google LLC is seeking a Senior GPU Performance Software Engineer, AI/ML, to join the ML-Omega team in London. You will help optimize, model, and evaluate GPU systems for benchmarking Google's internal ML workloads and for guiding future Cloud hardware decisions.

The role requires deep experience with ML algorithms, GPU programming, performance analysis, and collaboration with product teams to solve large-scale model performance challenges.