Lead Architect, GDC AI Inference Platform

Google Inc.; Sunnyvale (CA); On-site; USD 262,000 - 365,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Life insurance

Disability insurance

401(k) with company match

Paid time off

Sick time

Maternity leave

Holidays

Job summary

Google Cloud’s Senior Staff Software Engineer in GDC AI will architect the core infrastructure powering LLM serving and agent orchestration for enterprise customers. You will own the global platform strategy within Google Distributed Cloud AI, defining the technical vision for high-performance inference and secure execution environments.

You will collaborate with AI Research, SRE, Product, and core platform teams to deliver production-ready AI solutions and optimize resource utilization across

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience with software development and programming in C++, Java, Python, Kotlin, or Go.
• 5 years of experience testing, and launching software products.
• 4 years of experience in technical leadership leading architecture, design, and delivery of large-scale distributed systems or cloud infrastructure platforms.
• 3 years of experience with software design and architecture.

Responsibilities

• Define the GDC AI infrastructure roadmap for LLM serving and Agentic AI platforms, managing key architectural decisions, technology choices, and system health.
• Architect scalable, reliable LLM serving infrastructure, pioneering optimizations like disaggregated serving to maximize resource efficiency.
• Build core platforms and orchestration tools for multi-agent systems, tool integration, state persistence, and secure, isolated execution environments.
• Collaborate with AI Research, SRE, Product, and core platform teams to deliver production-ready AI solutions.
• Resolve ambiguous, high-impact systems issues balancing enterprise needs with architectural integrity.

Skills

C++

Java

Python

Kotlin

Go

Education

Bachelor's degree or equivalent

Tools

Kubernetes

Docker

Job description

Google Cloud’s Senior Staff Software Engineer in GDC AI will architect the core infrastructure powering LLM serving and agent orchestration for enterprise customers. You will own the global platform strategy within Google Distributed Cloud AI, defining the technical vision for high-performance inference and secure execution environments.

You will collaborate with AI Research, SRE, Product, and core platform teams to deliver production-ready AI solutions and optimize resource utilization across