Product Manager, Inference Platform

Baseten

San Francisco (CA)

On-site

USD 120,000 - 160,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive compensation with equity
100% coverage of health insurance
Generous PTO policy
Paid parental leave
Company-facilitated 401(k)
Exposure to ML startups

Job summary

A leading AI solutions provider in San Francisco seeks a Core Product Manager to shape the developer experience for their platform. You will drive the roadmap for APIs and UI workflows, ensuring a seamless interaction for teams leveraging AI applications. The ideal candidate has 4+ years of Product Management experience in developer tools or SaaS and an engineering background. This role offers competitive compensation and a diverse work environment.

Qualifications

  • 4+ years of Product Management experience in relevant fields.
  • Engineering background or equivalent hands-on experience.
  • Ability to simplify complex products for users.

Responsibilities

  • Own roadmap for core product surface including APIs and UI.
  • Partner with design and engineering for intuitive experiences.
  • Collaborate with customers to define solutions for AI deployment.
  • Drive product launches and improve onboarding experiences.
  • Align product initiatives with company strategy.

Skills

Product Management in developer tools
Empathy for developers
Cross-functional collaboration
Data-driven decision making

Education

Degree in Computer Science or related field

Job description

ABOUT BASETEN

Baseten powers inference for the world's most dynamic AI companies, including OpenEvidence, Clay, Mirage, Gamma, Sourcegraph, Writer, Abridge, Bland, and Zed. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting‑edge models into production. With our recent $150M Series D funding, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction, we’re scaling our team to meet accelerating customer demand.

THE ROLE

As a Core Product Manager at Baseten, you’ll shape the core developer experience that powers how users build, deploy, and manage AI applications on our platform. You’ll drive the roadmap for user‑facing APIs, SDKs, UI workflows, and integration surfaces, turning complex ML infrastructure into a seamless, intuitive product. Your work will directly impact how teams interact with Baseten day‑to‑day, ensuring that our platform is both powerful and a joy to use.

EXAMPLE INITIATIVES
  • Chains for multi‑component workflows
  • Asynchronous inference
  • Model APIs for frontier models
  • Model training built for production inference
RESPONSIBILITIES
  • Own the roadmap for Baseten’s core product surface, including APIs, UI, and developer workflows
  • Partner with design and engineering to deliver elegant, intuitive developer experiences
  • Collaborate with customers to deeply understand pain points and define solutions that simplify AI deployment
  • Drive new product launches and improve onboarding, observability, and management experiences
  • Align product initiatives with company strategy and ensure measurable product adoption and retention
REQUIREMENTS
  • 4+ years of Product Management experience in developer tools, SaaS, or ML platforms
  • Engineering background (e.g., degree in Computer Science, Electrical Engineering, or related field; or equivalent hands‑on experience as a software engineer)
  • Deep empathy for developers and an ability to translate technical complexity into simple, usable products
  • Experience driving cross‑functional alignment across design, engineering, and GTM teams
  • Proven ability to define product success metrics and iterate based on data and feedback
NICE TO HAVE
  • Familiarity with AI/ML workflows and inference products
  • Experience building products for technical users (e.g., APIs, SDKs, dashboards)
  • Background in developer experience or product‑led growth
BENEFITS
  • Competitive compensation, including meaningful equity.
  • 100% coverage of medical, dental, and vision insurance for employee and dependents.
  • Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year’s Day!).
  • Paid parental leave.
  • Company‑facilitated 401(k).
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward‑thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Product Manager - Dedicated Inference
Product Manager - Dedicated Inference

Baseten • New York (NY)

On-site
USD 200,000 - 285,000
Competitive compensation including equity
100% coverage of medical, dental, and vision insurance
Flexible PTO including company-wide Winter Break
+4
Product Manager, Inference Platform
Product Manager, Inference Platform

The Consensus • New York (NY)

On-site
USD 120,000 - 160,000
Competitive compensation including equity
100% coverage of medical, dental, and vision insurance
Flexible PTO including Winter Break
+4
Product Manager, Inference Platform
Product Manager, Inference Platform

Baseten • San Francisco (CA)

On-site
USD 210,000 - 280,000
Competitive equity
Medical, dental, vision insurance
Flexible PTO including Winter Break
+4
Software Engineer - Dedicated Inference
Software Engineer - Dedicated Inference

Baseten • New York (NY)

On-site
USD 150,000 - 230,000
Competitive compensation including meaningful equity.
100% coverage of medical, dental, and vision insurance.
Generous PTO policy including company-wide Winter Break.
+3
Software Engineer - Dedicated Inference
Software Engineer - Dedicated Inference

Baseten • San Francisco (CA)

On-site
USD 185,000 - 250,000
Competitive compensation, including meaningful equity.
100% coverage of medical, dental, and vision insurance.
Generous PTO policy including Winter Break.
+3
Product Manager, Developer Experience
Product Manager, Developer Experience

Baseten • San Francisco (CA)

On-site
USD 130,000 - 160,000
Competitive compensation including equity
100% coverage of medical, dental, and vision insurance
Flexible PTO policy
+4
Product Marketing Manager, Model API
Product Marketing Manager, Model API

The Consensus • New York (NY)

On-site
USD 90,000 - 130,000
Equity
Healthcare coverage
Flexible PTO
+2
Product Marketing Manager, Model API
Product Marketing Manager, Model API

Baseten • New York (NY)

On-site
USD 120,000 - 160,000
Equity
Insurance
Winter Break PTO
+3
Product Marketing Manager, Post-Training
Product Marketing Manager, Post-Training

Baseten • New York (NY)

On-site
USD 120,000 - 180,000
Equity
Full medical coverage
Flexible PTO
+2
Product Manager, Developer Experience
Product Manager, Developer Experience

The Consensus • San Francisco (CA)

On-site
USD 120,000 - 160,000
Competitive compensation including equity
100% health coverage
Flexible PTO
+2