Senior Staff Software Engineer, Cloud AI, Agent Governance

Google; Sunnyvale (CA); On-site; USD 262,000 - 364,000; Full time

Job summary

Google's engineers build next-generation technologies at scale, tackling AI, distributed systems, and data storage challenges. The teams push the state-of-the-art in AI and collaborate with product groups to deliver real-world impact.

Google Cloud AI Research focuses on innovative problems that scale to enterprise deployments, with an emphasis on governance for CISOs, auditors, and IT teams. The role involves leading complex, secure simulation environments and end-to-end evaluation pipelines.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 7 years leading technical project strategy, ML design, and optimizing industry-scale ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 5 years of experience with design and architecture, and testing, launching software products.
• 2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).

Responsibilities

• Architect, build, and operate large-scale environments that allow developers to test complex agent behaviors, tool calling, multi-turn workflows, and end-to-end workflows in isolated, reproducible sandboxes.
• Deliver reproducible evaluation infrastructure and automated test harnesses capable of validating against enterprise visibility, security, compliance requirements.
• Design and scale the platform infrastructure that enables agentic systems to validate online and audit offline and alert based on behavioral patterns.
• Build the metrics engines and dashboards to track evaluation coverage, semantic correctness, quality metrics, and regression signals over time. Standardize the use of metrics for production health.
• Integrate evaluation runs into deployment pipelines, creating release gates to prevent semantic and structural regressions before agent deployments reach production.

Skills

Distributed systems leadership

Engineering leadership

GenAI techniques

LLM execution mechanics

Telemetry and monitoring

Education

Bachelor's degree or equivalent practical experience

Job description

In most instances, this position requires in-person interviews as part of the hiring process.

Minimum qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 7 years of experience leading technical project strategy, ML design, and optimizing industry-scale ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 5 years of experience with design and architecture, and testing, launching software products.
• 2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).

Preferred qualifications

• 10 years of experience leading the design and implementation of scalable distributed systems, ML platforms, or observability infrastructure, ideally in the context of large-scale agent platforms.
• Experience leading engineering teams and collaborating with product managers and researchers to translate scientific concepts into reliable developer tools.
• Strong understanding of LLM execution mechanics, tool-calling APIs, and model-level failure analysis.
• Fluency in distributed tracing, semantic monitoring, and telemetry collection at scale.
• Proven track record of shipping complex enterprise-grade developer platforms, virtualization/sandbox environments, or production-grade test harnesses.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

With your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.

Google Cloud is building the most comprehensive AI platform in the industry. As platform adoption scales, enterprise customers require stable, highly scalable, and completely secure simulation environments and evaluation infrastructure to operationalize autonomous agents. This role focuses on the systems and platform engineering required to close the last mile of agentic governance for enterprise deployments.

You will lead the delivery of the engineering roadmap, integrating components from multiple product teams to build an intuitive governance user experience for CISOs, auditors, and enterprise IT teams.

The Google Cloud AI Research team addresses AI challenges motivated by Google Cloud’s mission of bringing AI to tech, healthcare, finance, retail and many other industries. We work on a range of unique problems focused on research topics that maximize scientific and real-world impact, aiming to push the state-of-the-art in AI and share findings with the broader research community. We also collaborate with product teams to bring innovations to real-world impact that benefits our customers. Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $262000 - $364000 (USD) + 25% bonus target + equity + benefits

Responsibilities

Learn more about benefits at Google .

• Architect, build, and operate large-scale environments that allow developers to test complex agent behaviors, tool calling, multi-turn workflows, and end-to-end workflows in isolated, reproducible sandboxes.
• Deliver reproducible evaluation infrastructure and automated test harnesses capable of validating against enterprise visibility, security, compliance requirements.
• Design and scale the platform infrastructure that enables agentic systems to validate online and audit offline and alert based on behavioral patterns.
• Build the metrics engines and dashboards to track evaluation coverage, semantic correctness, quality metrics, and regression signals over time. Standardize the use of metrics for production health.
• Integrate evaluation runs into deployment pipelines, creating release gates to prevent semantic and structural regressions before agent deployments reach production.

Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form .