Software Engineering Manager, AutoCloud, Context and Memory

Google; San Francisco (CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google is seeking a software engineer to advance AutoCloud’s memory and context capabilities. You will design architectures for memory systems, context synthesis, and hybrid search platforms, while mentoring a strong team of engineers.

The role blends leadership with hands-on technical work in ML infrastructure, information retrieval, and scalable cloud technologies, with a focus on privacy, multi-tenancy, and high availability. Location preference includes Sunnyvale or San Francisco, CA.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 3 years of experience in a technical leadership role.
• 2 years of experience with state of the art GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (e.g., language modeling, computer vision).
• 2 years of experience in a people management or team leadership role.

Responsibilities

• Define the technical roadmap and architecture for agent memory systems, dynamic context synthesis pipelines, graph-based cloud representations, and hybrid search/RAG platforms.
• Manage, mentor, and grow an exceptional team of software engineers. Drive talent acquisition, foster an engineering culture, conduct performance evaluations, and support career progress.
• Lead the design and implementation of low-latency context caching, token compression/pruning strategies, working memory buffers, and long-term episodic knowledge stores for autonomous agents.
• Build automated evaluation pipelines and benchmarking frameworks to measure and optimize context retrieval precision, memory recall, grounding fidelity, and hallucination reduction.
• Ensure all memory and context subsystems adhere to the highest standards of multi-tenant enterprise data privacy, tenant isolation, compliance, high availability, and operational efficiency. Partner with AutoCloud agent orchestration teams, and GCP service teams to seamlessly integrate cloud state into agent context.

Skills

Software development experience

ML design leadership

Technical leadership

GenAI techniques

People management

Matrixed organization experience

Multi-tenant architectures

Agent memory systems

Information Retrieval

Education

Bachelor's degree or equivalent practical experience

Master’s degree or PhD in Engineering/CS related field

Job description

Applicants in San Francisco: Qualified applications with arrest or conviction records will be considered for employment in accordance with the San Francisco Fair Chance Ordinance for Employers and the California Fair Chance Act.

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Sunnyvale, CA, USA; San Francisco, CA, USA.

Minimum qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 3 years of experience in a technical leadership role.
• 2 years of experience with state of the art GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (e.g., language modeling, computer vision).
• 2 years of experience in a people management or team leadership role.

Preferred qualifications

• Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
• 3 years of experience working in a complex, matrixed organization.
• Experience building multi-tenant architectures with strict access control, tenant isolation, and data governance standards.
• Proven experience designing agent memory systems (short-term/working memory, episodic/semantic memory), context caching (e.g., Gemini context caching), context compression/summarization, vector databases/embeddings, and knowledge graphs.
• Deep background in Information Retrieval (IR), hybrid search (semantic + lexical), graph data stores, and aggregating complex distributed state (logs, metrics, IAM, infrastructure topology).

About The Job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

With your extensive technical expertise you take initiative to independently design and implement new systems, designing, implementing, and testing multiple features with little or no direction from tech lead or manager. You collaborate with key stakeholders to determine future direction of work.

AutoCloud is Google Cloud’s autonomous, AI-powered cloud management portfolio. We are transforming how enterprise customers design, deploy, operate, investigate, and optimize their workloads and infrastructure across GCP. Autonomous agents are only as capable as the context and memory they operate on. The AutoCloud Context and Memory team is responsible for the core cognitive backbone that powers AutoCloud agents: managing short-term dynamic context, long-term episodic and semantic memory, cloud topology graphs, context caching, and intelligent retrieval across petabyte-scale cloud logs, metrics, configurations, and historical runbooks.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits

Responsibilities

Learn more about benefits at Google .

• Define the technical roadmap and architecture for agent memory systems, dynamic context synthesis pipelines, graph-based cloud representations, and hybrid search/RAG platforms.
• Manage, mentor, and grow an exceptional team of software engineers. Drive talent acquisition, foster an engineering culture, conduct performance evaluations, and support career progress.
• Lead the design and implementation of low-latency context caching, token compression/pruning strategies, working memory buffers, and long-term episodic knowledge stores for autonomous agents.
• Build automated evaluation pipelines and benchmarking frameworks to measure and optimize context retrieval precision, memory recall, grounding fidelity, and hallucination reduction.
• Ensure all memory and context subsystems adhere to the highest standards of multi-tenant enterprise data privacy, tenant isolation, compliance, high availability, and operational efficiency. Partner with AutoCloud agent orchestration teams, and GCP service teams to seamlessly integrate cloud state into agent context.

Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form .