Technical Program Manager, AI Inference & Model Performance

Baseten; New York (NY); On-site; USD 165,000 - 330,000; Full time

Benefits offered by this job

Equity

Medical, dental, vision insurance

Flexible PTO

Parental leave

401(k)

Learning opportunities

Job summary

Baseten is seeking their first Technical Program Manager for the Model Performance group in the United States. You will build a from-scratch planning and governance framework for high-performance inference, coordinating across engineering, infra, and release stakeholders to turn ambitious targets into reliable programs.

You will drive day-to-day execution, structuring cadences and metrics, while surfacing risks and aligning teams as scope expands into APIs and BIS.

Qualifications

• Deep technical program management experience at large, complex orgs.
• Experience in model performance or inference optimization is required.
• Ability to turn ambiguous initiatives into a governed program.
• Influence without authority across engineers, managers and leaders.
• Excellent written and verbal communication for technical audiences.
• High ownership and accountability with fast execution.

Responsibilities

• Own execution across Model Performance's active project portfolio.
• Design planning structures, operating cadences, and status reporting.
• Coordinate model release and optimization programs end to end.
• Drive cross-team alignment as scope grows to APIs and BIS.
• Surface risks and keep leadership informed with clear status.
• Partner with engineering leads to design team structures and boundaries.

Skills

Technical program management

Cross-team coordination

Executive communication

Ownership and accountability

Tools

vLLM

TensorRT-LLM

SGLang

NVIDIA Dynamo

Job description

Baseten is seeking their first Technical Program Manager for the Model Performance group in the United States. You will build a from-scratch planning and governance framework for high-performance inference, coordinating across engineering, infra, and release stakeholders to turn ambitious targets into reliable programs.

You will drive day-to-day execution, structuring cadences and metrics, while surfacing risks and aligning teams as scope expands into APIs and BIS.