Staff ML Frameworks Engineer – Scalable ML Infra

Socket.dev; Sunnyvale (CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google is seeking software engineers to help build next-generation ML infrastructure and accelerator ecosystems. You will work on large-scale ML systems, contribute to design, deployment, and optimization, and collaborate across teams to move fast while maintaining reliability.

You will drive technical strategy for ML workloads, improve efficiency with scaling and idle management, and deliver features for Google's accelerator fleet.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
• 5 years of experience with one or more ML areas (speech/audio, RL, ML infrastructure).
• 5 years of experience with ML design and ML infrastructure.

Responsibilities

• Drive technical strategy, roadmaps, and adoption for large-scale ML infrastructure development.
• Guide sustainable engineering choices for ML systems at scale.
• Seek opportunities to improve ML workloads using scaling, idle suspend, and other innovations.
• Deliver impactful software features for Google's accelerator fleet.
• Partner with GDM and other PAs to transfer key innovations into products.

Skills

Software development

ML infrastructure

ML design

Leadership qualities

Cross-functional collaboration

Education

Bachelor’s degree or equivalent practical experience

Master’s degree or PhD in Engineering or CS

Tools

TPUs

GPUs

Job description

Google is seeking software engineers to help build next-generation ML infrastructure and accelerator ecosystems. You will work on large-scale ML systems, contribute to design, deployment, and optimization, and collaborate across teams to move fast while maintaining reliability.

You will drive technical strategy for ML workloads, improve efficiency with scaling and idle management, and deliver features for Google's accelerator fleet.