Senior AI/ML Engineer - LLM/GenAI Backend + Equity

Google; New York (NY); On-site; USD 174,000 - 252,000; Full time

Job summary

Google’s software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. This role focuses on building scalable backend infrastructure and AI-powered features within the Geo team.

You will work on distributed systems, model evaluation, and tooling to improve user experiences across Google Maps platforms and related services. Collaboration across engineering, product, UX, and research is essential.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 5 years of experience developing C++ backend infrastructure components within distributed systems.
• 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
• Experience with Large Language Models (LLMs) and Generative AI concepts (e.g., prompt engineering, retrieval-augmented generation (RAG)).
• Experience with model quality optimization using methods such as loss analysis or quality hillclimbing.

Responsibilities

• Build context engineering pipelines, agentic workflows with tool usage, and robust evaluation frameworks.
• Analyze model behavior, creating high-quality evaluation datasets to identify weaknesses and guide performance improvements.
• Enhance serving and evaluation infrastructure to power new user-facing features.
• Act as a technical bridge between engineering, product, UX, and research teams to translate user needs into valuable features.
• Analyze user metrics and model outputs to enhance personalization and overall system helpfulness.

Skills

C++ backend development

Distributed systems

LLMs and Generative AI concepts

Model quality optimization

Prompt engineering

Education

Bachelor’s degree or equivalent practical experience

Tools

TensorFlow

JAX

PyTorch

Job description

Google’s software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. This role focuses on building scalable backend infrastructure and AI-powered features within the Geo team.

You will work on distributed systems, model evaluation, and tooling to improve user experiences across Google Maps platforms and related services. Collaboration across engineering, product, UX, and research is essential.