Senior AI/ML Infrastructure Engineer

Google; New York (NY); Hybrid; USD 194,000 - 253,000; Full time

Benefits offered by this job

Equity

Bonus target

Job summary

Google DeepMind is seeking a Software Engineer to help build and scale Gemini model serving infrastructure. You will design and implement systems to support large-scale ML workloads and streaming, with a focus on reliability and performance.

The role emphasizes deep collaboration, code reviews, and shaping short-term technical direction to meet evolving infrastructure needs. The group emphasizes safety and ethics alongside high-impact research.

Qualifications

• 3 years of experience in Productionizing large language and multimodal models or ML infrastructure development.
• 3 years of experience in C++ for software development.
• 3 years of experience in software testing across the lifecycle.

Responsibilities

• Build and enhance serving solutions for Gemini models and test configurations.
• Develop new infrastructure for large-scale streaming and audio logic within the orchestration framework.
• Guarantee production quality of Gemini models by triaging issues and monitoring.

Skills

C++ development

ML infrastructure

Productionizing LLMs

Software testing

Root cause analysis

Systems architecture

Education

Bachelor's degree (CS/Engineering/Math/Physics) + 5 years

Master's degree + 3 years

Job description

Google DeepMind is seeking a Software Engineer to help build and scale Gemini model serving infrastructure. You will design and implement systems to support large-scale ML workloads and streaming, with a focus on reliability and performance.

The role emphasizes deep collaboration, code reviews, and shaping short-term technical direction to meet evolving infrastructure needs. The group emphasizes safety and ethics alongside high-impact research.