Principal Engineer: GKE Platform for AI Inference

Google Inc.; Seattle, Kirkland (WA, WA); On-site; USD 307,000 - 427,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Life insurance

Disability insurance

401(k) with match

PTO 20 days per year

Sick time 40 hours/year (Seattle 69)

Job summary

Google Cloud's GKE Platform is seeking a Principal Engineer to reinvent AI inference workloads at scale. You will lead architectural reinvention for llm‑d, driving distributed infrastructure and high‑throughput networking across the GKE fleet.

Collaborate with DeepMind and Vertex AI to co‑define an AI‑first roadmap, leveraging Google's custom silicon to optimize throughput and density, while contributing to the CNCF OSS ecosystem.

Qualifications

• Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.
• 15 years of experience in software engineering, or 15 years of experience with an advanced degree.
• Experience building distributed systems and driving technical strategy for platform-level infrastructure.
• Experience with Kubernetes, container runtimes, and AI/ML infrastructure (e.g., inference serving, LLM, hardware accelerators).

Responsibilities

• Lead the architectural direction for llm‑d, ensuring a highly optimized, scalable foundation for distributed LLM and RL serving across the GKE fleet.
• Define GKE's evolution to support massive‑scale inference and RL, solving orchestration problems in resource allocation and multi‑host scheduling.
• Partner with AI model builders to co‑develop an AI‑first roadmap and optimize throughput with custom silicon.
• Lead the broader Kubernetes OSS community, driving upstream initiatives to set standards for AI orchestration.

Skills

Kubernetes

Distributed systems

AI/ML infrastructure

High‑performance networking

Education

Bachelor's degree in Computer Science or related field

Master's degree or PhD in Computer Science or related field

Job description

Google Cloud's GKE Platform is seeking a Principal Engineer to reinvent AI inference workloads at scale. You will lead architectural reinvention for llm‑d, driving distributed infrastructure and high‑throughput networking across the GKE fleet.

Collaborate with DeepMind and Vertex AI to co‑define an AI‑first roadmap, leveraging Google's custom silicon to optimize throughput and density, while contributing to the CNCF OSS ecosystem.