Senior Technical Program Manager, AI Infra & FDE

Baseten; New York (NY); On-site; USD 165,000 - 330,000; Full time

Benefits offered by this job

Equity compensation

Medical insurance

Flexible PTO

Parental leave

Fertility stipend

401(k)

Learning opportunities

Job summary

Baseten is seeking a Forward Deployed Engineering leader to scale a high-visibility team that tackles the hardest inference problems for top customers. You will own operating rhythms, align multiple teams, and drive programs across large accounts while maintaining strong exec-level communication.

The role emphasizes technical depth in ML infrastructure, Kubernetes, GPUs, and distributed systems, with direct exposure to customers and leadership.

Qualifications

• 5+ years as a TPM or engineer turned TPM on infrastructure, cloud or customer-facing technical programs.
• Technical depth in ML Infra, Kubernetes, GPUs, distributed systems; familiarity with incident channels or design docs.

Responsibilities

• Run the priority account cadence for top accounts with leadership.
• Coordinate cross-team programs for large customers and ensure clear ownership, cadence, and SLAs.
• Build and report a metrics scorecard on account health, response times, toil, and team health.
• Drive hiring enablement, onboarding, and certification; collaborate with Recruiting on operations.

Skills

TPM experience

ML Infra

Kubernetes

GPUs

Distributed systems

LLM inference

Tools

Kubernetes

GPUs

LLM inference

Distributed systems

Job description

Baseten is seeking a Forward Deployed Engineering leader to scale a high-visibility team that tackles the hardest inference problems for top customers. You will own operating rhythms, align multiple teams, and drive programs across large accounts while maintaining strong exec-level communication.

The role emphasizes technical depth in ML infrastructure, Kubernetes, GPUs, and distributed systems, with direct exposure to customers and leadership.