Tech Lead — On-Prem AI Infrastructure & Orchestration

Google

Sunnyvale (CA)

On-site

USD 207,000 - 300,000

Full time

12 days ago
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Bonus target
Equity
Benefits

Job summary

Google is seeking software engineers to join a team building an on-premises AI supercomputer and advanced AI hardware. You will work across full-stack areas, integrating with Kubernetes and custom orchestration tools, and help drive scalable, secure infrastructure for AI workloads.

Responsibilities include defining roadmaps, owning platform architecture, and mentoring engineers while contributing to high-availability, observability, and fleet management.

Qualifications

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development across one or more languages (Python, C, C++, Java, JavaScript).
  • 5 years building and developing large-scale infrastructure, distributed systems, or networks.
  • 5 years testing and launching software products.
  • 3 years experience with software design and architecture.

Responsibilities

  • Define the technical roadmap and architecture for inventory and fleet management, focusing on Temporal orchestration, automated node re-bootstrapping, and self-service remediation.
  • Own architectural and design decisions for the platform, collaborating with leadership and cross-functional teams to prioritize efforts and manage technical debt.
  • Establish and maintain machine health SLOs, driving continuous improvements in fleet-wide observability and environmental monitoring.
  • Foster a culture of engineering excellence by establishing shared responsibility models with tenant teams and enforcing robust system-level access guardrails.
  • Coach and mentor engineers on the team, guiding their technical development and helping them grow their impact.

Skills

Programming languages
Distributed systems
Software testing
Software design
Experience with large-scale infra

Education

Bachelor's degree or equivalent practical experience

Tools

Kubernetes
ArgoCD
Temporal orchestration
Container orchestration

Job description

Google is seeking software engineers to join a team building an on-premises AI supercomputer and advanced AI hardware. You will work across full-stack areas, integrating with Kubernetes and custom orchestration tools, and help drive scalable, secure infrastructure for AI workloads.

Responsibilities include defining roadmaps, owning platform architecture, and mentoring engineers while contributing to high-availability, observability, and fleet management.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Tech Lead, AI Infra & TPU Systems
Tech Lead, AI Infra & TPU Systems

Google Inc. • Sunnyvale (CA)

On-site
USD 207,000 - 300,000
Equity
Benefits
Staff Software Engineer: Emerging On-Prem AI Infrastructure
Staff Software Engineer: Emerging On-Prem AI Infrastructure

Epic Games (Portuguese) • Kirkland (WA)

On-site
USD 197,000 - 291,000
Senior Performance AI & Infra Engineer
Senior Performance AI & Infra Engineer

Google • Kirkland (WA)

On-site
USD 174,000 - 253,000
Health, dental, vision, life, and disb
401(k) with company match
Paid time off 20 days/year
+4
Tech Lead, TPU AI Infrastructure
Tech Lead, TPU AI Infrastructure

Google • Sunnyvale (CA)

On-site
USD 207,000 - 300,000
Bonus target
Equity
Benefits
Staff AI/ML Engineer, Cloud Infrastructure Lead
Staff AI/ML Engineer, Cloud Infrastructure Lead

Google • San Jose (CA)

On-site
USD 207,000 - 300,000
Health insurance
Dental insurance
Vision insurance
+8
Senior Software Engineer, AI & Large-Scale Infra
Senior Software Engineer, AI & Large-Scale Infra

Google • New York (NY)

On-site
USD 147,000 - 210,000
Health, dental, vision, life, and/or其它
401(k) with company match
Paid Time Off: 20 days/year
+4
AI Platform Tech Lead — GKE & Cloud ML Infra
AI Platform Tech Lead — GKE & Cloud ML Infra

Google • Seattle (WA)

On-site
USD 207,000 - 301,000
Health insurance
Dental insurance
Vision insurance
+5
Cloud AI Tech Lead & Large-Scale Systems Architect
Cloud AI Tech Lead & Large-Scale Systems Architect

Google • Sunnyvale (CA)

On-site
USD 262,000 - 364,000
Senior AI/ML Software Engineer — Equity & Large‑Scale Infra
Senior AI/ML Software Engineer — Equity & Large‑Scale Infra

Google • Mountain View (CA)

On-site
USD 174,000 - 253,000
AI Transformation & Accelerator Systems Architect
AI Transformation & Accelerator Systems Architect

Google • Sunnyvale (CA)

On-site
USD 262,000 - 364,000