Senior ML Infrastructure Architect

Socket.dev; Sunnyvale (CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google Software Engineers work on a large-scale distributed system critical to AI adoption for Google Cloud Platform. You will drive core infra pieces, including Gemini-related tooling and quality gates, and collaborate across Google Cloud, DeepMind, and external AI ecosystems.

Responsibilities include designing distributed ML infrastructure, leading evaluation workflows, and mentoring junior engineers while maintaining reliability and performance.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8 years of software development experience.
• 5 years testing, launching software products, and 3 years in design/architecture.
• 5 years in ML design, ML infrastructure and deployment.
• Experience integrating generative AI tools or LLM interfaces.

Responsibilities

• Design, build, and scale large-scale distributed ML infrastructure and tooling.
• Lead development of AI quality components, evaluation workflows, and gates.
• Lead robust software design, automated testing, and on-call rotations.
• Coach and mentor engineers, enforce architectural best practices.

Skills

Software development

Testing & releasing software

ML infrastructure

Generative AI integration

Leadership in ML projects

Education

Bachelor’s degree or equivalent practical experience

Master’s degree or PhD in Engineering/CS or related

Job description

Google Software Engineers work on a large-scale distributed system critical to AI adoption for Google Cloud Platform. You will drive core infra pieces, including Gemini-related tooling and quality gates, and collaborate across Google Cloud, DeepMind, and external AI ecosystems.

Responsibilities include designing distributed ML infrastructure, leading evaluation workflows, and mentoring junior engineers while maintaining reliability and performance.