Staff ML Compiler Performance Engineer - Co-Design

Google; Mountain View (CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google in Mountain View seeks a senior software engineer to advance TPU, ML workloads, and high-performance systems. You will design, test, and deploy software across large-scale data analysis, performance optimization, and compiler integration.

The role requires strong C++/Python, 8+ years of experience, and the ability to lead complex initiatives across teams. You will contribute to open-source model mappings and TPU performance strategies.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience programming in C++ or Python.
• 5 years of experience testing, and launching software products.
• 5 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging.
• 3 years of experience with software design and architecture.

Responsibilities

• Deliver certified performance benchmarks six months pre-pilot as primary targets for pricing, capacity planning, and kernel optimization.
• Adapt emerging open-source models into TPU-native paired variants, including sparsity optimization, to demonstrate differentiated TPU performance.
• Ingest and optimize multi-turn agentic workflows, reasoning loops, and prompt and decode topologies prior to silicon tape-out.
• Author robust reference implementations using PyTorch, JAX, or Pallas that meet pre-pilot goals under compiler constraints.
• Partner with director and executive technical leadership across TPU Hardware, XLA Compiler, and Cloud AI Systems to steer multi-year roadmaps.

Skills

C++

Python

Testing

Performance analysis

Software design

Education

Bachelor's degree or equivalent pr.

Tools

MLIR

XLA

JAX

PyTorch

Pallas

Triton

CUDA

Job description

Google in Mountain View seeks a senior software engineer to advance TPU, ML workloads, and high-performance systems. You will design, test, and deploy software across large-scale data analysis, performance optimization, and compiler integration.

The role requires strong C++/Python, 8+ years of experience, and the ability to lead complex initiatives across teams. You will contribute to open-source model mappings and TPU performance strategies.