Staff ML Systems Engineer for GPU Accelerators

Google; Sunnyvale (CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google in Sunnyvale, CA is seeking a Staff Software Engineer for ML Systems and Accelerators to lead architecture and delivery of scalable AI infrastructure across GPUs/TPUs. You will drive long-term technical roadmap and cross-functional collaboration with hardware teams, ensuring reliable, high-performance ML platforms for Google Cloud and internal workloads.

The role requires owning outcomes, solving ambiguous problems, and guiding a distributed team to deliver at scale in a fast-paced

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience programming in C++.
• 5 years of experience testing, and launching software products.
• 5 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.
• 3 years of experience with software design and architecture.
• Experience with GPU programming, machine learning infrastructure, AI platform, machine learning optimization, and systems infrastructure.

Responsibilities

• Define the architecture and long-term technical roadmap for Google’s accelerator software stacks, focusing on distributed systems, Linux OS, networking, power management, and hardware interfaces.
• Collaborate with HW engineering to design, test, deploy, and debug low-level software across the stack—including firmware, kernel drivers, simulators, and cluster configurations for next-gen TPUs, GPUs, and custom accelerators.
• Provide technical leadership, mentorship, and coaching to a distributed team while fostering cross-functional alignment on goals, timelines, and program outcomes.
• Manage priorities and end-to-end deliverables to power Google's AI hyper-computers and data centers, supporting internal workloads and Google Cloud offerings.
• Drive large-scale technical programs to maximize production health, reliability, and scalability of distributed accelerator systems in partnership with multiple teams.

Skills

C++ programming

Distributed systems

GPU programming

Machine learning infrastructure

Technical leadership

Education

Bachelor's degree or equivalent

Master’s degree or PhD in Engineering/CS

Tools

GPU/TPU Kernel Development

XLA

JAX/PyTorch

Job description

Google in Sunnyvale, CA is seeking a Staff Software Engineer for ML Systems and Accelerators to lead architecture and delivery of scalable AI infrastructure across GPUs/TPUs. You will drive long-term technical roadmap and cross-functional collaboration with hardware teams, ensuring reliable, high-performance ML platforms for Google Cloud and internal workloads.

The role requires owning outcomes, solving ambiguous problems, and guiding a distributed team to deliver at scale in a fast-paced