Senior AI/ML Engineer — Geo & Gemini (Equity + Bonus)

Google LLC; New York (NY); On-site; USD 174,000 - 252,000; Full time

Job summary

Google LLC is seeking a Senior Software Engineer specializing in AI/ML for Geo and Gemini. You will work on backend infrastructure with C++ within distributed systems, focusing on LLMs, prompt engineering, RAG, and quality optimization.

The role involves design leadership and cross-team collaboration in a fast-paced environment. You will contribute to the Geo team, building maps-centric AI features, evaluating models, and integrating scalable solutions for billions of users.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 5 years of experience developing C++ backend infrastructure components within distributed systems.
• 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
• Experience with Large Language Models (LLMs) and Generative AI concepts (e.g., prompt engineering, retrieval-augmented generation).
• Experience with model quality optimization using loss analysis or quality hillclimbing.

Responsibilities

• Build context engineering pipelines, agentic workflows with tool usage, and robust evaluation frameworks.
• Analyze model behavior, creating high-quality evaluation datasets to identify weaknesses and guide performance improvements.
• Enhance serving and evaluation infrastructure to power new user-facing features.
• Act as a technical bridge between engineering, product, UX, and research teams to translate user needs into valuable features.
• Analyze user metrics and model outputs to enhance personalization and overall system helpfulness.

Skills

C++ backend infrastructure

Software testing & architecture

LLMs & Generative AI

Model quality optimization

Distributed systems

Education

Bachelor’s degree or equivalent

Tools

TensorFlow

JAX

PyTorch

Job description

Google LLC is seeking a Senior Software Engineer specializing in AI/ML for Geo and Gemini. You will work on backend infrastructure with C++ within distributed systems, focusing on LLMs, prompt engineering, RAG, and quality optimization.

The role involves design leadership and cross-team collaboration in a fast-paced environment. You will contribute to the Geo team, building maps-centric AI features, evaluating models, and integrating scalable solutions for billions of users.