Staff ML Systems Co-Design Engineer

Google; United States; On-site; USD 207,000 - 300,000; Full time

Benefits offered by this job

Health, dental, vision, life, and/ or

401(k) with company match

PTO 20 days per year

Sick Time 40 hours/year

Maternity Leave 28-30 weeks

Baby Bonding Leave 18 weeks

13 paid holidays per year

Job summary

Google's Staff Software Engineer, ML Systems Co-Design role sits at the intersection of machine-learning workloads and TPU silicon roadmaps. You will own the strategy for enabling open-source models to achieve TPU performance with internal models at launch, and establish scalable methodologies to analyze mapping gaps across model families.

You will lead cross-functional initiatives across hardware design, compilers, AI research, and cloud infrastructure, collaborating with senior engineers to

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience programming in C++ or Python.
• 5 years of experience testing and launching software products.
• 5 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging.
• 3 years of experience with software design and architecture.

Responsibilities

• Deliver certified performance ladders 6 months pre-pilot as the definitive goals for pricing, capacity planning, and XLA/kernel optimization.
• Adapt emerging open-source models into TPU-native paired variants (e.g., sparsity optimization) to prove asymmetric TPU superiority.
• Ingest and optimize multi-turn agentic workflows, reasoning loops, and prompt/decode disaggregated topologies ahead of silicon.
• Author high-signal reference implementations (PyTorch/JAX/Pallas) that guarantee reachability of pre-pilot goals under real-world compiler constraints.
• Partner with director and executive technical leadership across TPU Hardware, XLA Compiler, and Cloud AI Systems to steer multi-year roadmaps.

Skills

C++

Python

Performance analysis

Large-scale systems

Debugging

Architecture design

Education

Bachelor's degree or equivalent practical experience

Tools

JAX

PyTorch

XLA

MLIR

Triton

CUDA

Job description

Google's Staff Software Engineer, ML Systems Co-Design role sits at the intersection of machine-learning workloads and TPU silicon roadmaps. You will own the strategy for enabling open-source models to achieve TPU performance with internal models at launch, and establish scalable methodologies to analyze mapping gaps across model families.

You will lead cross-functional initiatives across hardware design, compilers, AI research, and cloud infrastructure, collaborating with senior engineers to