ML Performance Engineering Manager

Google; United States; On-site; USD 207,000 - 300,000; Full time

Benefits offered by this job

Health, dental, vision

401(k) with company match

Paid time off 20 days

Sick time 40 hours/year

Maternity leave 28-30 weeks

Baby bonding leave 18 weeks

Holidays 13 paid days

Job summary

Google Sunnyvale, CA / Kirkland, WA is seeking an Engineering Manager for ML Performance to lead teams dedicated to maximizing the speed and efficiency of TPUs and ML workloads. You will oversee ML training and inference benchmarks, drive performance improvements, and coordinate across cross-functional teams.

The role combines technical leadership with people management, guiding project goals, product strategy, and talent development across multiple sites.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8 years of software development experience.
• 5 years of ML design and infrastructure optimization; 3 years in technical leadership; 2 years people management.
• Experience with ML performance analysis and architecture.

Responsibilities

• Lead a team of software engineers focused on identifying and maintaining ML training and serving benchmarks that are representative to Google production and the broader ML industry.
• Achieve performance for customer launches and for engaged benchmark submissions (ML Commons, InferenceX, etc.).
• Use benchmarks to identify performance opportunities and drive both near-term SOTA and out-of-the-box performance enhancements.
• Participate in algorithmic innovations exploiting new TPU hardware features and model-preserving optimizations.
• Participate in co-designing models that are TPU-friendly for OSS models and GPUs.

Skills

ML performance analysis

Leadership

Decision making

Ambiguity solving

Stakeholder influence

Education

Bachelor’s degree or equivalent practical experience

Master’s degree or PhD preferred

Tools

CUDA

Triton

Pallas

PyTorch

JAX

vLLM

MLIR/OpenXLA

OpenXLA

Job description

Google Sunnyvale, CA / Kirkland, WA is seeking an Engineering Manager for ML Performance to lead teams dedicated to maximizing the speed and efficiency of TPUs and ML workloads. You will oversee ML training and inference benchmarks, drive performance improvements, and coordinate across cross-functional teams.

The role combines technical leadership with people management, guiding project goals, product strategy, and talent development across multiple sites.