ML Accelerators Software Engineer – Inference & Compiler

Google Inc.; Mountain View, San Francisco (CA, CA); On-site; USD 174,000 - 252,000; Full time

Job summary

DeepMind in Mountain View is seeking a Software Engineer focused on ML accelerators and the ML compiler stack to drive inference infrastructure. This is a hands-on role for engineers who take initiative and deliver results, bridging AI workloads with low-level hardware operators.

You will collaborate with scientists and engineers across Google DeepMind to build a next-generation compute platform for AI inference, with emphasis on memory technologies, hardware acceleration, and software/hardware

Qualifications

• Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.
• Experience in software development using Python and C++.
• Experience with machine learning (ML) hardware accelerators, ML compiler stacks (e.g., JAX, PyTorch, XLA), and kernel development.

Responsibilities

• Direct full-stack Software role, focusing on ML compiler and inference infrastructure.
• Design and develop ML compiler stack to bridge AI workloads and low-level Hardware operators.
• Design and develop SW infrastructure to enable high performance inference.
• Drive SW/HW codesign, kernel optimization, performance tuning, and debugging.

Skills

Python

C++

ML accelerators

ML compiler stacks

Kernel development

Education

Bachelor's degree in Computer Science or related field

Tools

JAX

PyTorch

XLA

Job description

DeepMind in Mountain View is seeking a Software Engineer focused on ML accelerators and the ML compiler stack to drive inference infrastructure. This is a hands-on role for engineers who take initiative and deliver results, bridging AI workloads with low-level hardware operators.

You will collaborate with scientists and engineers across Google DeepMind to build a next-generation compute platform for AI inference, with emphasis on memory technologies, hardware acceleration, and software/hardware