Staff Software Engineer, Agentic, Optimization, Recursive Self-Improvement

Google

Mountain View (CA)

On-site

USD 207,000 - 300,000

Full time

13 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Google LLC is seeking a Staff Software Engineer in Mountain View, CA to contribute to RSI, APO, and agentic prompts. You will help set technical direction for autonomous, closed-loop systems that optimize, compress, and modularize instructions and trajectories at scale.

The role emphasizes improving instruction-following fidelity, reasoning quality, and inference efficiency across multimodal journeys in Search, with opportunities to impact billions of users globally.

Qualifications

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of software development experience.
  • 5 years of ML design and with LLM/multimodal agent architectures.
  • Experience utilizing agentic AI frameworks or developer kits to build and deploy autonomous AI systems.
  • Experience in automated LLM evaluation (e.g., LLM-as-a-Judge, multi-turn user simulation, or Pareto optimization).

Responsibilities

  • Partner with senior leads to architect closed-loop RSI pipelines that autonomously diagnose failure modes, refine instructions/trajectories, synthesize targeted training/eval data, and verify gains without manual intervention.
  • Investigate and build automated multi-agent systems that audit, compress, and de-conflict complex model context—maximizing token efficiency and inference speed while preserving behavioral and safety guardrails.
  • Bridge inference-time context engineering with model post-training (SFT/RL) to distill complex rules into model weights.
  • Advance automated optimization methods for production multimodal and reasoning systems.
  • Help define the multi-quarter roadmap across Engineering and Research teams, establishing rigorous automated evaluation gates.

Skills

ML design
LLM architectures
Autonomous systems
Agentic AI
Leadership

Education

Bachelor’s degree

Tools

DSPy
OPRO
TextGrad
Reflexion
STaR

Job description

Staff Software Engineer, Agentic, Optimization, Recursive Self-Improvement

Share Staff Software Engineer, Agentic, Optimization, Recursive Self-Improvement

corporate_fare Google place Mountain View, CA, USA

X In most instances, this position requires in-person interviews as part of the hiring process.

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience with ML design and with LLM/multimodal agent architectures.
  • Experience utilizing agentic AI frameworks or developer kits to build and deploy autonomous AI systems.

Experience in automated LLM evaluation (e.g., LLM-as-a-Judge, multi-turn user simulation, or Pareto optimization).

  • Experience integrating generative AI tools or LLM interfaces into workflows and designing metrics for the AI tools.
Preferred qualifications:
  • 8 years of experience with data structures and algorithms.
  • 3 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.
  • Experience building Recursive Self-Improvement, automated prompt, or agent refinement frameworks (e.g., DSPy, OPRO, TextGrad, Reflexion, STaR).
  • Experience elevating performance on benchmarks for instruction-following, multimodal reasoning, and agents.
  • Experience with prompt compression, structured output enforcement, or context-to-weight distillation.
About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

We are looking for a Staff Software Engineer to help our efforts in Recursive Self-Improvement (RSI), Automated Prompt Optimization (APO), and Agentic prompt simplification. We are working towards ensuring that multimodal journeys in Search are fully onboarded onto RSI, and we also motivate horizontal improvements across Search from our learnings.

In this role, you will help set and execute the technical direction as part of a strong team for autonomous, closed-loop agentic systems that continuously optimize, compress, and modularize system instructions and agent trajectories—improving instruction-following fidelity, reasoning quality, and inference efficiency at scale.

In Google Search, we're reimagining what it means to search for information – any way and anywhere. To do that, we need to solve complex engineering challenges and expand our infrastructure, while maintaining a universally accessible and useful experience that people around the world rely on. In joining the Search team, you'll have an opportunity to make an impact on billions of people globally.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits

  • Partner with senior leads to architect closed-loop RSI pipelines that autonomously diagnose failure modes, refine instructions/trajectories, synthesize targeted training/eval data, and verify gains without manual intervention.
  • Investigate and build automated multi-agent systems that audit, compress, and de-conflict complex model context—maximizing token efficiency and inference speed while preserving behavioral and safety guardrails.
  • Bridge inference-time context engineering with model post-training (SFT/RL) to distill complex rules into model weights.
  • Advance automated optimization methods for production multimodal and reasoning systems.
  • Help define the multi-quarter roadmap across Engineering and Research teams, establishing rigorous automated evaluation gates.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy , Know your rights: workplace discrimination is illegal , Belonging at Google , and How we hire .

Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.

To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.

Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Software Engineer, AI/ML GenAI, Search Intelligence
Staff Software Engineer, AI/ML GenAI, Search Intelligence

Google • Mountain View (CA)

On-site
USD 207,000 - 300,000
Senior Staff AI/ML Research Engineer, Cloud AI Research
Senior Staff AI/ML Research Engineer, Cloud AI Research

Google LLC • Mountain View (CA)

On-site
USD 262,000 - 364,000
Health insurance
Equity
Staff AI/ML Engineer, Cloud AI Research
Staff AI/ML Engineer, Cloud AI Research

Google • Sunnyvale (CA)

On-site
USD 207,000 - 300,000
Staff Software Engineer, Search Ads Syndication Quality AI/ML
Staff Software Engineer, Search Ads Syndication Quality AI/ML

Google • Mountain View (CA)

On-site
USD 207,000 - 300,000
Senior Staff Software Engineer, AI Mode and AI Overviews Helpfulness
Senior Staff Software Engineer, AI Mode and AI Overviews Helpfulness

Google LLC • New York (NY)

On-site
USD 262,000 - 364,000
Equity
Bonus target
Software Engineering Manager, Business AI Agent
Software Engineering Manager, Business AI Agent

Google LLC • Mountain View (CA)

On-site
USD 207,000 - 300,000
Staff ML Software Engineer, Search Ecosystem
Staff ML Software Engineer, Search Ecosystem

Google • Mountain View (CA)

On-site
USD 207,000 - 300,000
Software Engineering Manager, AI/ML, Google Labs
Software Engineering Manager, AI/ML, Google Labs

Google • Mountain View (CA)

On-site
USD 207,000 - 300,000
Senior Software Engineer, AI/ML, Search Live, Infrastructure
Senior Software Engineer, AI/ML, Search Live, Infrastructure

Google • Mountain View (CA)

On-site
USD 174,000 - 252,000
Staff Software Engineer, Full Stack (Agent Registry/App Hub)
Staff Software Engineer, Full Stack (Agent Registry/App Hub)

Google LLC • Sunnyvale (CA)

On-site
USD 207,000 - 300,000