Staff Software Engineer, Cloud Agentic AI

Google Inc.; Sunnyvale (CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google Inc. Sunnyvale seeks a Staff Software Engineer for Cloud Agentic AI to own end-to-end memory architectures, context synthesis, and distributed systems for autonomous agents.

You will lead low-latency caching, memory stores, and scalable platform design, coordinating with DeepMind and Google Cloud teams to deliver secure, high-performance solutions.

Qualifications

• Bachelor’s degree in Computer Science, AI/ML, Data Systems, Information Retrieval, a related technical field, or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
• 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).
• 2 years of experience building infrastructure on cloud platforms.

Responsibilities

• Own the end-to-end architecture, technical roadmap, and core goal for agent memory systems, dynamic context synthesis pipelines, graph-based cloud representations, and hybrid search/RAG platforms.
• Lead the design and implementation of low-latency context caching, token compression/pruning strategies, working memory buffers, and long-term episodic knowledge stores for autonomous agents.
• Architect high-throughput, low-latency distributed systems and automated benchmarking frameworks to ensure sub-second cloud state aggregation, high retrieval recall, and hallucination mitigation.
• Ensure all context and memory subsystems meet stringent enterprise-grade multi-tenancy standards, tenant data isolation policies, compliance mandates, and fine-grained access controls.
• Partner across research (e.g., DeepMind) and platform service teams to standardize shared context models and APIs, while mentoring engineers and upholding architectural review standards.

Skills

Outcome ownership

Ambiguity solving

Stakeholder influence

Domain expertise

Education

Bachelor’s degree in CS/AI/ML/Data Systems/IR

Master’s degree or PhD in Engineering/CS

Job description

Staff Software Engineer, Cloud Agentic AI

Google place Sunnyvale, CA, USA

Advanced

Experience owning outcomes and decision making, solving ambiguous problems and influencing stakeholders;deep expertise in domain.

• Bachelor's degree in Computer Science, AI/ML, Data Systems, Information Retrieval, a related technical field, or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
• 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).
• 2 years of experience building infrastructure on cloud platforms.

Preferred qualifications:

• Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
• Experience building low-latency, high-availability distributed storage systems and APIs on major cloud platforms.
• Expertise in agent memory (working/episodic), context caching, token pruning, vector search, and knowledge graphs.
• Ability to define technical roadmaps, author comprehensive design docs, and align multi-organization stakeholders. Demonstrated skill in coaching engineers and clearly communicating complex architectures to leadership and research partners.
• Track record in hybrid search, graph databases, and querying complex cloud telemetry and topology.
• Background in engineering secure, multi-tenant cloud architectures with strict data isolation and compliance controls.

About the job

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google Cloud's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. You will anticipate our customer needs and be empowered to act like an owner, take action and innovate. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

AutoCloud is Google Cloud’s autonomous, AI-powered cloud management portfolio. We are transforming how enterprise customers design, deploy, operate, investigate, and optimize their workloads and infrastructure across Google Cloud Platform (GCP). In this role, you will be the principal technical authority guiding the design of scalable memory architectures, solving complex state retrieval issues, and partnering with Principal Engineers, researchers across DeepMind, and partner teams across Google Cloud to deliver a high-precision, low-latency, and secure context platform for autonomous operations.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting‑edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems. Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits

• Own the end-to-end architecture, technical roadmap, and core goal for agent memory systems, dynamic context synthesis pipelines, graph-based cloud representations, and hybrid search/RAG platforms.
• Lead the design and implementation of low-latency context caching, token compression/pruning strategies, working memory buffers, and long-term episodic knowledge stores for autonomous agents.
• Architect high-throughput, low-latency distributed systems and automated benchmarking frameworks to ensure sub‑second cloud state aggregation, high retrieval recall, and hallucination mitigation.
• Ensure all context and memory subsystems meet stringent enterprise-grade multi-tenancy standards, tenant data isolation policies, compliance mandates, and fine-grained access controls.
• Partner across research (e.g., DeepMind) and platform service teams to standardize shared context models and APIs, while mentoring engineers and upholding architectural review standards.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents‑to‑be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy , Know your rights: workplace discrimination is illegal , Belonging at Google , and How we hire .

Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.

To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.

Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right.