Tech Lead, TPU AI Infra: Architect On-Prem AI Supercomputer

Google

Kirkland (WA)

On-site

USD 207,000 - 300,000

Full time

7 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Health insurance
401(k) with company match
Paid Time Off: 20 days per year
Sick Time: 40 hours/year
Maternity Leave (Short-Term Disability
Baby Bonding Leave: 18 weeks
Holidays: 13 paid days

Job summary

Google is seeking a Tech Lead for TPU AI Infrastructure to guide the on-prem AI hardware software stack and drive the technical roadmap across a distributed system. You will influence cross-functional teams, own architecture decisions, and shape platform capabilities to meet demanding performance and reliability requirements.

The role requires deep expertise in scalable infrastructure, wear many hats, and collaborate with leadership to deliver high-impact solutions while maintaining strong

Qualifications

  • Bachelor's degree or equivalent practical experience.
  • 8 years of software development experience in one or more languages.
  • 5 years building large-scale infrastructure or distributed systems.
  • 5 years testing and launching software products.
  • 3 years of software design and architecture.

Responsibilities

  • Define the technical roadmap and architecture for inventory and fleet management, focusing on Temporal orchestration, automated node re-bootstrapping, and self-service remediation.
  • Own architectural and design decisions for the platform, collaborating with leadership and cross-functional teams to prioritize efforts, resolve roadblocks, and manage technical debt.
  • Establish and maintain machine health Service Level Objectives (SLOs), driving continuous improvements in fleet-wide observability and environmental monitoring.
  • Foster a culture of engineering excellence by establishing shared responsibility models with tenant teams and enforcing robust system-level access guardrails.
  • Coach and mentor engineers on the team, guiding their technical development and helping them grow their impact.

Skills

Python
C
C++
Java
JavaScript

Education

Bachelor's degree or equivalent practical experience

Tools

Kubernetes
ArgoCD
Temporal
Container orchestration
PXE

Job description

Google is seeking a Tech Lead for TPU AI Infrastructure to guide the on-prem AI hardware software stack and drive the technical roadmap across a distributed system. You will influence cross-functional teams, own architecture decisions, and shape platform capabilities to meet demanding performance and reliability requirements.

The role requires deep expertise in scalable infrastructure, wear many hats, and collaborate with leadership to deliver high-impact solutions while maintaining strong

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Tech Lead, AI Infra & TPU Systems
Tech Lead, AI Infra & TPU Systems

Google Inc. • Sunnyvale (CA)

On-site
USD 207,000 - 300,000
Equity
Benefits
Tech Lead — On-Prem AI Infrastructure & Orchestration
Tech Lead — On-Prem AI Infrastructure & Orchestration

Google • Sunnyvale (CA)

On-site
USD 207,000 - 300,000
Bonus target
Equity
Benefits
Senior AI Infrastructure Field Architect
Senior AI Infrastructure Field Architect

Google • Chicago (IL)

On-site
USD 233,000 - 324,000
Health insurance
401(k) match
Paid time off
Senior AI Infrastructure Architect, Cloud & Data Center
Senior AI Infrastructure Architect, Cloud & Data Center

Google • Sunnyvale (CA)

On-site
USD 233,000 - 324,000
Health Insurance
401(k) with company match
Paid time off 20 days
+4
Senior AI Infrastructure Field Solutions Architect
Senior AI Infrastructure Field Solutions Architect

Google • Atlanta (GA)

On-site
USD 233,000 - 324,000
Senior AI/TPU Infra Firmware Engineer (On-Prem)
Senior AI/TPU Infra Firmware Engineer (On-Prem)

Google • Mobile (AL)

On-site
USD 174,000 - 252,000
Health insurance
Dental insurance
Vision insurance
+2
TPU Compute RTL Design Engineer for AI Hardware
TPU Compute RTL Design Engineer for AI Hardware

Google • Austin (TX)

On-site
USD 138,000 - 197,000
Senior AI TPU Hardware-Software Integration Engineer
Senior AI TPU Hardware-Software Integration Engineer

Google • Sunnyvale (CA)

On-site
USD 163,000 - 236,000
Health benefits
TPU Compute RTL Design Engineer - AI Hardware Innovator
TPU Compute RTL Design Engineer - AI Hardware Innovator

Google Inc. • Austin (TX)

Hybrid
USD 138,000 - 197,000
Equity
Benefits
Senior AI/ML Infra Engineer - TPU Health & Diagnoser
Senior AI/ML Infra Engineer - TPU Health & Diagnoser

Google • Town of Montana (WI)

On-site
USD 174,000 - 252,000
Health insurance
Dental insurance
Vision insurance
+2