Software Engineering Manager, AutoCloud, Context and Memory

Socket.dev; Sunnyvale (CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google’s AutoCloud team seeks engineers to design and implement agent memory systems, context synthesis pipelines, and hybrid search platforms for autonomous cloud agents.

You will mentor engineers, drive talent acquisition, and ensure privacy, availability, and efficiency across multi-tenant environments. This role emphasizes leadership, collaboration, and technical excellence in large-scale AI infrastructure.

Qualifications

• Bachelor's degree or equivalent practical experience required.
• 8 years of software development experience.
• 5 years leading ML design and optimizing ML infrastructure.
• 3 years in a technical leadership role.
• 2 years with GenAI techniques or related concepts.
• 2 years of people management or team leadership.

Responsibilities

• Define the technical roadmap and architecture for memory systems and context pipelines.
• Manage, mentor, and grow an engineering team; drive talent acquisition and performance evaluations.
• Lead design and implementation of memory caches, compression, and long-term knowledge stores for autonomous agents.
• Build automated evaluation pipelines to measure retrieval precision, memory recall, and grounding.
• Ensure multi-tenant data privacy, tenant isolation, and compliance across cloud memory subsystems.

Skills

Software development

ML design

Leadership

GenAI techniques

People management

Education

Bachelor's degree or equivalent

Master's or PhD in Engineering/CS

Tools

Vector databases

Embeddings

Knowledge graphs

Graph databases

Job description

Minimum qualifications:

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 3 years of experience in a technical leadership role.
• 2 years of experience with state of the art GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (e.g., language modeling, computer vision).
• 2 years of experience in a people management or team leadership role.

Preferred qualifications:

• Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
• 3 years of experience working in a complex, matrixed organization.
• Experience building multi-tenant architectures with strict access control, tenant isolation, and data governance standards.
• Proven experience designing agent memory systems (short-term/working memory, episodic/semantic memory), context caching (e.g., Gemini context caching), context compression/summarization, vector databases/embeddings, and knowledge graphs.
• Deep background in Information Retrieval (IR), hybrid search (semantic + lexical), graph data stores, and aggregating complex distributed state (logs, metrics, IAM, infrastructure topology).

About the job:

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. With your extensive technical expertise you take initiative to independently design and implement new systems, designing, implementing, and testing multiple features with little or no direction from tech lead or manager. You collaborate with key stakeholders to determine future direction of work.

AutoCloud is Google Cloud’s autonomous, AI-powered cloud management portfolio. We are transforming how enterprise customers design, deploy, operate, investigate, and optimize their workloads and infrastructure across GCP. Autonomous agents are only as capable as the context and memory they operate on. The AutoCloud Context and Memory team is responsible for the core cognitive backbone that powers AutoCloud agents: managing short-term dynamic context, long-term episodic and semantic memory, cloud topology graphs, context caching, and intelligent retrieval across petabyte-scale cloud logs, metrics, configurations, and historical runbooks.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits

Learn more about benefits at Google.

Responsibilities:

• Define the technical roadmap and architecture for agent memory systems, dynamic context synthesis pipelines, graph-based cloud representations, and hybrid search/RAG platforms.
• Manage, mentor, and grow an exceptional team of software engineers. Drive talent acquisition, foster an engineering culture, conduct performance evaluations, and support career progress.
• Lead the design and implementation of low-latency context caching, token compression/pruning strategies, working memory buffers, and long-term episodic knowledge stores for autonomous agents.
• Build automated evaluation pipelines and benchmarking frameworks to measure and optimize context retrieval precision, memory recall, grounding fidelity, and hallucination reduction.
• Ensure all memory and context subsystems adhere to the highest standards of multi-tenant enterprise data privacy, tenant isolation, compliance, high availability, and operational efficiency. Partner with AutoCloud agent orchestration teams, and GCP service teams to seamlessly integrate cloud state into agent context.