AI & TPU Infra TPM — Lead Scalable ML Systems

Google LLC; Sunnyvale (CA); On-site; USD 192,000 - 278,000; Full time

Benefits offered by this job

Bonus target

Equity grants

Benefits

Job summary

Google LLC is seeking a Technical Program Manager for AI2, TPU Software in Sunnyvale. Lead complex, cross-team initiatives spanning TPU hardware, ML frameworks, and scalable inference. Manage requirements, risks, schedules, and stakeholder communications with engineers and executives.

You will drive strategy for production-grade ML infrastructure, coordinate with Jax and PyTorch teams, and expand support into multimodal and world models while automating onboarding pipelines.

Qualifications

• Bachelor's degree in a technical field or equivalent practical experience.
• 8+ years of experience in program management.
• Experience with AI/ML projects, tools, or infrastructure.

Responsibilities

• Develop and execute end-to-end program strategies for ML infrastructure and TPU ecosystem.
• Partner with cross-functional teams to define milestones and platform capabilities.
• Drive execution across workstreams, manage dependencies and risks, and report to leadership.
• Ensure production-readiness and scale for hardware/software deployments and developer adoption.
• Communicate technical tradeoffs and strategic recommendations to executives.

Skills

JAX

PyTorch

Qwen

GLM

vLLM

SGLang

Education

Bachelor's degree in a technical field

Job description

Google LLC is seeking a Technical Program Manager for AI2, TPU Software in Sunnyvale. Lead complex, cross-team initiatives spanning TPU hardware, ML frameworks, and scalable inference. Manage requirements, risks, schedules, and stakeholder communications with engineers and executives.

You will drive strategy for production-grade ML infrastructure, coordinate with Jax and PyTorch teams, and expand support into multimodal and world models while automating onboarding pipelines.