Staff ML Systems Co-Design Engineer

Google; Mountain View (CA); On-site; USD 207,000 - 300,000; Full time

Benefits offered by this job

Health, dental, vision insurance

401(k) with company match

Paid time off

Sick time

Maternity leave

Baby bonding leave

Holidays

Job summary

Google’s software engineers develop the next-generation technologies that power billions of users. The MARC team focuses on open-source ML models to achieve TPU performance with internal models at launch, aligning with TPU roadmaps and compiler constraints.

This role requires leadership across hardware, compilers, AI research, and cloud AI systems. As part of Google's AI and Infrastructure teams, you will shape multi-year roadmaps, design high-performance software, and collaborate with

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience programming in C++ or Python.
• 5 years of experience testing, and launching software products.
• 5 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging.
• 3 years of experience with software design and architecture.

Responsibilities

• Deliver certified performance ladders 6 months pre-pilot as the definitive goals for pricing, capacity planning, and XLA/kernel optimization.
• Adapt emerging open-source models into TPU-native paired variants (e.g., sparsity optimization) to prove asymmetric TPU superiority.
• Ingest and optimize multi-turn agentic workflows, reasoning loops, and prompt/decode disaggregated topologies ahead of silicon.
• Author high-signal reference implementations (PyTorch/JAX/Pallas) that guarantee reachability of pre-pilot goals under real-world compiler constraints.
• Partner with director and executive technical leadership across TPU Hardware, XLA Compiler, and Cloud AI Systems to steer multi-year roadmaps.

Skills

C++

Python

Software testing

Product launch

Performance analysis

Software architecture

Education

Bachelor's degree or equivalent practical experience

Tools

MLIR

XLA

HLO

JAX

PyTorch

PyTorch/XLA

CUDA

Triton

Pallas

Job description

Google’s software engineers develop the next-generation technologies that power billions of users. The MARC team focuses on open-source ML models to achieve TPU performance with internal models at launch, aligning with TPU roadmaps and compiler constraints.

This role requires leadership across hardware, compilers, AI research, and cloud AI systems. As part of Google's AI and Infrastructure teams, you will shape multi-year roadmaps, design high-performance software, and collaborate with