Product Manager - Dedicated Inference

Baseten; New York (NY); On-site; USD 200,000 - 285,000; Full time

Benefits offered by this job

Competitive compensation including equity

100% coverage of medical, dental, and vision insurance

Flexible PTO including company-wide Winter Break

Paid parental leave

Fertility and family-building stipend

Company-facilitated 401(k)

Exposure to ML startups

Job summary

A leading AI platform provider in New York seeks a Core Product Manager to shape the developer experience for AI applications. You will drive the roadmap for user-facing APIs, SDKs, and UI workflows. Ideal candidates have over 4 years of product management experience in developer tools or SaaS. The position offers competitive compensation ranges from $200K to $285K and includes comprehensive benefits such as health insurance and flexible PTO.

Qualifications

• 4+ years of product management experience in SaaS or developer tools.
• Ability to translate technical details into usable products.
• Experience with product success metrics and data-driven decision-making.

Responsibilities

• Own the product roadmap for APIs and UI.
• Collaborate with design and engineering teams.
• Drive new product launches and enhance user experiences.

Skills

Product Management experience

Empathy for developers

Cross-functional collaboration

Education

Degree in Computer Science or related field

Job description

About Baseten

Baseten powers mission‑critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting‑edge models into production. We’re growing quickly and recently raised our $300M Series E, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products.

The Role

As a Core Product Manager at Baseten, you’ll shape the core developer experience that powers how users build, deploy, and manage AI applications on our platform. You’ll drive the roadmap for user‑facing APIs, SDKs, UI workflows, and integration surfaces, turning complex ML infrastructure into a seamless, intuitive product. Your work will directly impact how teams interact with Baseten day‑to‑day, ensuring that our platform is both powerful and a joy to use.

Example Initiatives

• Chains for multi‑component workflows
• Asynchronous inference
• Model APIs for frontier models
• Model training built for production inference

Responsibilities

• Own the roadmap for Baseten’s core product surface, including APIs, UI, and developer workflows.
• Partner with design and engineering to deliver elegant, intuitive developer experiences.
• Collaborate with customers to deeply understand pain points and define solutions that simplify AI deployment.
• Drive new product launches and improve onboarding, observability, and management experiences.
• Align product initiatives with company strategy and ensure measurable product adoption and retention.

Requirements

• 4+ years of Product Management experience in developer tools, SaaS, or ML platforms.
• Engineering background (e.g., degree in Computer Science, Electrical Engineering, or related field; or equivalent hands‑on experience as a software engineer).
• Deep empathy for developers and an ability to translate technical complexity into simple, usable products.
• Experience driving cross‑functional alignment across design, engineering, and GTM teams.
• Proven ability to define product success metrics and iterate based on data and feedback.

Nice to Have

• Familiarity with AI/ML workflows and inference products.
• Experience building products for technical users (e.g., APIs, SDKs, dashboards).
• Background in developer experience or product‑led growth.

Benefits

• Competitive compensation, including meaningful equity.
• 100% coverage of medical, dental, and vision insurance for employee and dependents.
• Flexible PTO policy including company‑wide Winter Break (our offices are closed from Christmas Eve to New Year’s Day!).
• Paid parental leave.
• Fertility and family‑building stipend through Carrot.
• Company‑facilitated 401(k).
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Equal Employment Opportunity

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Compensation Range

$200K – $285K