AI Infra TPM: Scale GPU & Inference

GMI Cloud; Mountain View (CA); On-site; USD 150,000 - 230,000; Full time

Job summary

GMI Cloud is seeking a Technical Program Manager to own and drive complex programs spanning GPU infrastructure, Kubernetes platforms, and AI services. You will lead cross-functional teams from design to production, ensuring on-time delivery with high quality.

The role requires a hands-on TPM mindset, strong communication, and the ability to balance product tradeoffs with technical rigor in a fast-moving environment.

Qualifications

• Proven ability to drive cross-functional technical programs from design to production with strong ownership and execution discipline.
• Strong judgment around API reliability, latency, scalability, rollout quality, and operational readiness for production AI services.
• Experience with AI infrastructure, GPU-based inference, and distributed systems is highly valued.

Responsibilities

• Own end-to-end delivery of complex technical programs across AI infrastructure, GPU platforms, and cloud services.
• Define goals, milestones, dependencies, risks, and success metrics for multi-team initiatives.
• Drive execution rigor: timelines, accountability, escalation, and delivery predictability.
• Ensure programs reach production-ready quality, not just prototype or design completion.
• Partner with engineering to translate designs into executable delivery plans and monitor production readiness.

Skills

Program management

Production sense

AI/LLM systems

Inference & serving

AI infrastructure

Communication

Education

Bachelor’s or Master’s in CS/Engineering

Job description

GMI Cloud is seeking a Technical Program Manager to own and drive complex programs spanning GPU infrastructure, Kubernetes platforms, and AI services. You will lead cross-functional teams from design to production, ensuring on-time delivery with high quality.

The role requires a hands-on TPM mindset, strong communication, and the ability to balance product tradeoffs with technical rigor in a fast-moving environment.