AI Inference Platform Engineer — Production ML Tools

Baseten

United States

Remote

USD 140,000 - 210,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Medical insurance
Dental & Vision
Paid parental leave
Fertility stipend
401(k)
Learning exposure

Job summary

Baseten is seeking a Product Engineer for its Dedicated Inference team to shape the developer experience for deploying AI workloads. You’ll work on the CLI, SDKs, APIs, observability, and debugging workflows to support mission-critical inference deployments.

The role offers breadth across frontend and backend work, including React components and Kubernetes, with opportunities to influence product decisions for key customers.

Qualifications

  • Bachelor's degree or higher in Computer Science or related field.
  • Proficient coding abilities in Python, Go, or JavaScript.
  • Familiarity with web applications databases.
  • Strong collaboration and communication skills.
  • Interest in ML/AI infrastructure and willingness to learn.

Responsibilities

  • Implement new features and products for the Dedicated Inference team.
  • Design ergonomic APIs and abstractions to solve customer problems.
  • Fix bugs and resolve customer issues with urgency.
  • Work across the stack, touching React components and Kubernetes Pods.
  • Collaborate with product and forward deployed teams to drive new ideas.

Skills

Python
Go
JavaScript
React

Education

Bachelor's degree in Computer Science or related field

Tools

React
Kubernetes
APIs design

Job description

Baseten is seeking a Product Engineer for its Dedicated Inference team to shape the developer experience for deploying AI workloads. You’ll work on the CLI, SDKs, APIs, observability, and debugging workflows to support mission-critical inference deployments.

The role offers breadth across frontend and backend work, including React components and Kubernetes, with opportunities to influence product decisions for key customers.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Product Manager – AI Infrastructure & Scale
Senior Product Manager – AI Infrastructure & Scale

Baseten • United States

Remote
USD 150,000 - 190,000
AI Inference & Platform Marketing Lead
AI Inference & Platform Marketing Lead

Baseten • United States

Remote
USD 170,000 - 230,000
Remote-first work environment
In-person team summits
Unlimited PTO
+4
Senior Distributed Systems Engineer — AI Inference Platform
Senior Distributed Systems Engineer — AI Inference Platform

Baseten • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
Comprehensive medical for US
Flexible PTO
+4
Product Marketing Manager, AI Inference Platform
Product Marketing Manager, AI Inference Platform

Baseten • San Francisco (CA)

On-site
USD 170,000 - 220,000
Competitive compensation
Medical, dental, and vision insurance
Flexible PTO incl. Winter Break
+4
Senior ML Inference Engineer — Scale Production APIs
Senior ML Inference Engineer — Scale Production APIs

AssemblyAI, Inc. • New York (NY)

On-site
USD 190,000 - 225,000
Distributed Systems Engineer — AI Inference Platform
Distributed Systems Engineer — AI Inference Platform

Emploive • New York (NY)

On-site
USD 180,000 - 360,000
Competitive compensation with equity
100% healthcare coverage for employee
Flexible PTO including Winter Break
+4
Staff Inference Engineer — Production-Scale AI Platform
Staff Inference Engineer — Production-Scale AI Platform

Designworks Talent LLC • Bellevue (KY)

Hybrid
USD 180,000 - 240,000
Health insurance
401(k) plan with company match
Paid holidays
Staff ML Engineer - Efficient Production Inference
Staff ML Engineer - Efficient Production Inference

ATBF Labs • San Francisco (CA)

Hybrid
USD 215,000 - 285,000
Equity
Health benefits
Forward-Deployed AI Inference Engineer
Forward-Deployed AI Inference Engineer

BaseTen • New York (NY), San Francisco (CA)

Hybrid
USD 140,000 - 210,000
Equity
Healthcare coverage
Flexible PTO & Winter Break
+4
Senior Inference Engineer: Build Production-Grade AI APIs
Senior Inference Engineer: Build Production-Grade AI APIs

AssemblyAI, Inc. • Washington

On-site
USD 190,000 - 225,000