Senior AI/ML Engineer, Rapid Response Team

Google Inc.; Mountain View (CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google Inc. in Mountain View, CA is hiring an AI/ML Engineer for the AI Rapid Response Team. You will translate ambiguous directives into concrete, high-impact engineering plans.

The role requires deep software and ML design expertise, and a proven ability to drive projects from concept to production at scale. You will work across the full stack, mentor junior engineers, and help manage compute and latency constraints.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
• 5 years of experience with one or more: speech/audio, reinforcement learning, ML infrastructure, or specialization in another ML field.
• 5 years of experience with ML design and ML infrastructure (model deployment, evaluation, data processing, debugging, fine tuning).
• Experience integrating generative AI tools or LLM interfaces into workflows.

Responsibilities

• Lead technical architecture and system design for complex ML workloads on the AI Rapid Response Team.
• Design, prototype, and write robust production C++ and Python code for model compression and efficient serving pipelines.
• Diagnose latency and throughput bottlenecks across AI infra, implementing kernel and memory optimizations.

Education

Bachelor’s degree

Master’s degree or PhD

Tools

CUDA

XLA

Pallas

Triton

Custom Ops

Job description

Google Inc. in Mountain View, CA is hiring an AI/ML Engineer for the AI Rapid Response Team. You will translate ambiguous directives into concrete, high-impact engineering plans.

The role requires deep software and ML design expertise, and a proven ability to drive projects from concept to production at scale. You will work across the full stack, mentor junior engineers, and help manage compute and latency constraints.