Technical Program Manager — AI Inference Platform

Baseten

United States

Remote

USD 140,000 - 170,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Baseten is seeking its first Technical Program Manager for the Model Performance organization. You will own end-to-end execution across a portfolio of initiatives, from planning structures to cross-functional alignment, enabling rapid productization of inference innovations.

This is a zero-to-one role that requires turning ambitious ideas into a governed program with clear milestones. You will work closely with engineering, research, and product teams to ensure timely delivery, manage risks, and

Qualifications

  • Deep technical program management experience across complex initiatives.
  • Experience program-managing model performance or inference optimization work.
  • Comfort with ambiguity and zero-to-one program building, not just executing existing frameworks.
  • Proven ability to influence engineers, managers, and leadership who don’t report to you.
  • Excellent written and verbal communication, with the ability to explain technical concepts clearly.

Responsibilities

  • Own execution across Model Performance's active project portfolio.
  • Design and stand up planning structures, cadences, and status reporting.
  • Coordinate model release and optimization programs end to end.
  • Drive cross-team alignment as scope expands into APIs and inference stack.
  • Surface risks and dependencies early and keep leadership informed.

Skills

Program management
Model performance
Ambiguity handling
Influence without authority
Technical communication

Job description

Baseten is seeking its first Technical Program Manager for the Model Performance organization. You will own end-to-end execution across a portfolio of initiatives, from planning structures to cross-functional alignment, enabling rapid productization of inference innovations.

This is a zero-to-one role that requires turning ambitious ideas into a governed program with clear milestones. You will work closely with engineering, research, and product teams to ensure timely delivery, manage risks, and

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Technical Program Manager — AI Inference Platform Lead
Technical Program Manager — AI Inference Platform Lead

Neura Market • San Francisco (CA), Northern (KY)

Hybrid
USD 140,000 - 210,000
Equity
Medical coverage
Flexible PTO
+3
Technical Program Manager, AI Inference & Model Performance
Technical Program Manager, AI Inference & Model Performance

Baseten • New York (NY)

On-site
USD 165,000 - 330,000
Equity
Medical, dental, vision insurance
Flexible PTO
+3
Technical Program Manager, Model Performance (Zero-to-One)
Technical Program Manager, Model Performance (Zero-to-One)

Baseten • San Francisco (CA), Northern (KY)

Hybrid
USD 170,000 - 230,000
Competitive compensation
Equity
Medical/dental/vision insurance
+4
Technical Program Manager - AI Inference Platform
Technical Program Manager - AI Inference Platform

Applied Methods Ltd • San Francisco (CA), Northern (KY)

Hybrid
USD 140,000 - 190,000
Technical Program Manager, Model Performance
Technical Program Manager, Model Performance

Neura Market • San Francisco (CA), Northern (KY)

Hybrid
USD 140,000 - 210,000
Equity
Medical coverage
Flexible PTO
+3
Technical Program Manager, Model Performance
Technical Program Manager, Model Performance

Baseten • New York (NY)

On-site
USD 165,000 - 330,000
Equity
Medical, dental, vision insurance
Flexible PTO
+3
Senior Product Manager – AI Infrastructure & Scale
Senior Product Manager – AI Infrastructure & Scale

Baseten • United States

Remote
USD 150,000 - 190,000
AI Inference Platform Engineer
AI Inference Platform Engineer

BaseTen • New York (NY), San Francisco (CA)

On-site
USD 140,000 - 210,000
Equity
Medical, dental and vision insurance (
Flexible PTO including Winter Break
+4
Technical Program Manager, Model Performance
Technical Program Manager, Model Performance

Baseten • San Francisco (CA), Northern (KY)

On-site
USD 170,000 - 230,000
Competitive compensation
Equity
Medical/dental/vision insurance
+4
AI Inference Tech PM — Remote & Impactful
AI Inference Tech PM — Remote & Impactful

Positron • United States

Remote
USD 200,000 - 350,000
Medical insurance
Dental & Vision
Life & Disability insurance
+6