Staff Software Engineer, AutoCloud, Context and Memory

Google Inc.; Sunnyvale (CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google Cloud is seeking Staff Software Engineer, AutoCloud, Context and Memory, to own the architecture of memory systems, context pipelines, and hybrid search platforms. You will lead the design of low-latency caching, memory buffers, and large-scale state retrieval for autonomous operations.

You will collaborate with researchers across Google Cloud/DeepMind, mentor engineers, and drive architectural standards while delivering scalable, secure cloud context solutions across enterprise workloads.

Qualifications

• Bachelor's degree in CS, AI/ML, Data Systems, IR, or related field.
• 8 years of software development experience.
• 5 years testing and launching software products; 3 years in design/architecture.
• 5 years leading ML design and optimizing ML infrastructure.
• 2 years experience with GenAI techniques.
• 2 years building cloud platform infrastructure.

Responsibilities

• Own end-to-end architecture and core goals for memory systems and hybrid search platforms.
• Lead low-latency context caching and memory management strategies.
• Architect high-throughput distributed systems and benchmarking frameworks.
• Ensure multi-tenant data isolation and compliance across subsystems.
• Mentor engineers and align across research and platform teams.

Skills

Software development

Software testing & deployment

Software design & architecture

ML design & infrastructure

GenAI techniques

Cloud infrastructure

Education

Bachelor's degree in CS/AI-related field

Job description

Staff Software Engineer, AutoCloud, Context and Memory

corporate_fare Google place Sunnyvale, CA, USA

Advanced

Experience owning outcomes and decision making, solving ambiguous problems and influencing stakeholders;deep expertise in domain.

• link Copy link
• Bachelor's degree in Computer Science, AI/ML, Data Systems, Information Retrieval, a related technical field, or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
• 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).
• 2 years of experience building infrastructure on cloud platforms.

Preferred qualifications:

• Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
• Experience building low‑latency, high‑availability distributed storage systems and APIs on major cloud platforms.
• Expertise in agent memory (working/episodic), context caching, token pruning, vector search, and knowledge graphs.
• Ability to define technical roadmaps, author comprehensive design docs, and align multi‑organization stakeholders. Demonstrated skill in coaching engineers and clearly communicating complex architectures to leadership and research partners.
• Track record in hybrid search, graph databases, and querying complex cloud telemetry and topology.
• Background in engineering secure, multi‑tenant cloud architectures with strict data isolation and compliance controls.

About the job

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google Cloud's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. You will anticipate our customer needs and be empowered to act like an owner, take action and innovate. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

AutoCloud is Google Cloud’s autonomous, AI-powered cloud management portfolio. We are transforming how enterprise customers design, deploy, operate, investigate, and optimize their workloads and infrastructure across Google Cloud Platform (GCP). In this role, you will be the principal technical authority guiding the design of scalable memory architectures, solving complex state retrieval issues, and partnering with Principal Engineers, researchers across DeepMind, and partner teams across Google Cloud to deliver a high-precision, low-latency, and secure context platform for autonomous operations.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems. Individual pay is determined by factors including job-related skills, experience, and relevant education or training.
US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits
Learn more about benefits at Google .

• Own the end-to-end architecture, technical roadmap, and core goal for agent memory systems, dynamic context synthesis pipelines, graph-based cloud representations, and hybrid search/RAG platforms.
• Lead the design and implementation of low-latency context caching, token compression/pruning strategies, working memory buffers, and long-term episodic knowledge stores for autonomous agents.
• Architect high-throughput, low-latency distributed systems and automated benchmarking frameworks to ensure sub-second cloud state aggregation, high retrieval recall, and hallucination mitigation.
• Ensure all context and memory subsystems meet stringent enterprise-grade multi-tenancy standards, tenant data isolation policies, compliance mandates, and fine-grained access controls.
• Partner across research (e.g., DeepMind) and platform service teams to standardize shared context models and APIs, while mentoring engineers and upholding architectural review standards.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy , Know your rights: workplace discrimination is illegal , Belonging at Google , and How we hire .

Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.

To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.

Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right.