Staff Software Engineer - TPU Performance & ML Infra

Google; Ionia (NY); On-site; USD 207,000 - 300,000; Full time

Job summary

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale and extend well beyond web search.

We're looking for engineers who bring fresh ideas across AI, NLP, and large-scale systems; the roles span many domains and projects. Google's Core Machine Learning team focuses on TPUs, Gemini, and OSS ML models to optimize performance on

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience with ML design and ML infrastructure (model deployment, evaluation, data processing, debugging, fine tuning).
• 5 years of experience testing and launching software products, and 3 years of experience with software design and architecture.

Responsibilities

• Identify and maintain ML training and serving benchmarks that are representative to Google production and broader ML industry.
• Achieve performance for customer launches, and in case of third-party/Open-Source Software models, for engaged benchmark submissions.
• Use the benchmarks to identify performance opportunities and drive out-of-the-box performance toward improving the compiler, runtime, etc., in collaboration with those teams.
• Engage with Google Product teams and researchers to solve their performance problems (e.g., onboard new ML models and products on Google new TPU hardware).
• Analyze performance and efficiency metrics to identify bottlenecks, design, and implement solutions at Google fleet-wide scale.

Skills

Advanced software development

ML design & infrastructure

Speech/Audio/RL/ML acceleration

Testing & product launches

Education

Bachelor's degree or equivalent practical experience

Tools

CUDA/OpenCL

OpenXLA/MLIR/Triton

TensorFlow/PyTorch

Job description

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale and extend well beyond web search.

We're looking for engineers who bring fresh ideas across AI, NLP, and large-scale systems; the roles span many domains and projects. Google's Core Machine Learning team focuses on TPUs, Gemini, and OSS ML models to optimize performance on