Senior Staff AI Inference Platform Architect LLM, Agents

Google; Kirkland (WA); On-site; USD 262,000 - 365,000; Full time

Benefits offered by this job

Health insurance

Retirement Benefits

Paid Time Off

Sick Time

Maternity Leave

Baby Bonding Leave

Holidays

Job summary

Google Cloud’s mission is to make every business successful through AI by combining cutting‑edge technology, infrastructure, and talent. AI/ML software engineers in Cloud bridge the gap between pioneering models and a massive product vehicle reaching billions.

As a Senior Staff Software Engineer, you will architect the core infrastructure powering Google’s most advanced Large Language Models (LLM) and emerging Agentic AI capabilities, owning a global platform strategy within GDC AI.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience with software development, programming in C++, Java, Python, Kotlin, or Go.
• 5 years of experience testing, and launching software products.
• 4 years of experience in technical leadership (as a Tech Lead, Staff, or Principal Engineer) leading the architecture, design, and delivery of large-scale distributed systems or cloud infrastructure platforms.
• 3 years of experience with software design and architecture.

Responsibilities

• Define the GDC AI infrastructure roadmap for LLM serving and Agentic AI platforms, managing key architectural decisions, technology choices, and system health.
• Architect scalable, reliable LLM serving infrastructure, pioneering crucial optimizations like disaggregated serving to maximize resource and hardware efficiency.
• Build the core platforms and orchestration tools necessary for multi‑agent systems, seamless tool integration, state persistence, and secure, isolated execution environments.
• Collaborate with AI Research, Site Reliability Engineering (SRE), Product, and core platform teams to align and deliver integrated, production‑ready AI solutions.
• Resolve ambiguous, high‑impact systems issues, balancing immediate enterprise customer needs with architectural integrity.

Skills

Software development

Technical leadership

Architecture & design

Software testing

Programming languages

Education

Bachelor's degree or equivalent practical experience

Master’s or PhD in Engineering/CS

Tools

Kubernetes

Docker

Cloud platforms

Job description

Google Cloud’s mission is to make every business successful through AI by combining cutting‑edge technology, infrastructure, and talent. AI/ML software engineers in Cloud bridge the gap between pioneering models and a massive product vehicle reaching billions.

As a Senior Staff Software Engineer, you will architect the core infrastructure powering Google’s most advanced Large Language Models (LLM) and emerging Agentic AI capabilities, owning a global platform strategy within GDC AI.