AI Inference Platform Engineer — Production ML Tools

Baseten

United States

Remote

USD 140,000 - 210,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Equity
Medical insurance
Dental & Vision
Paid parental leave
Fertility stipend
401(k)
Learning exposure

Job summary

Baseten is seeking a Product Engineer for its Dedicated Inference team to shape the developer experience for deploying AI workloads. You’ll work on the CLI, SDKs, APIs, observability, and debugging workflows to support mission-critical inference deployments.

The role offers breadth across frontend and backend work, including React components and Kubernetes, with opportunities to influence product decisions for key customers.

Qualifications

  • Bachelor's degree or higher in Computer Science or related field.
  • Proficient coding abilities in Python, Go, or JavaScript.
  • Familiarity with web applications databases.
  • Strong collaboration and communication skills.
  • Interest in ML/AI infrastructure and willingness to learn.

Responsibilities

  • Implement new features and products for the Dedicated Inference team.
  • Design ergonomic APIs and abstractions to solve customer problems.
  • Fix bugs and resolve customer issues with urgency.
  • Work across the stack, touching React components and Kubernetes Pods.
  • Collaborate with product and forward deployed teams to drive new ideas.

Skills

Python
Go
JavaScript
React

Education

Bachelor's degree in Computer Science or related field

Tools

React
Kubernetes
APIs design

Job description

Baseten is seeking a Product Engineer for its Dedicated Inference team to shape the developer experience for deploying AI workloads. You’ll work on the CLI, SDKs, APIs, observability, and debugging workflows to support mission-critical inference deployments.

The role offers breadth across frontend and backend work, including React components and Kubernetes, with opportunities to influence product decisions for key customers.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Product Manager – AI Infrastructure & Scale
Senior Product Manager – AI Infrastructure & Scale

Baseten • United States

Remote
USD 150,000 - 190,000
AI Backend Engineer — Inference & Orchestration
AI Backend Engineer — Inference & Orchestration

Bjak • Germany (OH)

On-site
USD 110,000 - 150,000
Backend AI Engineer: Production-Grade Inference
Backend AI Engineer: Production-Grade Inference

European Recruitment BV • United States

On-site
USD 120,000 - 160,000
Forward-Deployed AI Engineer: Scale Inference & Ship Solutions
Forward-Deployed AI Engineer: Scale Inference & Ship Solutions

Triwill Group • San Francisco (CA), Northern (KY)

Hybrid
USD 140,000 - 190,000
Equity
Medical, dental, vision coverage fore
Flexible PTO
+4
AI Platform Engineer: Production ML & Kubernetes
AI Platform Engineer: Production ML & Kubernetes

Lightning AI • New York (NY)

Hybrid
USD 115,000 - 140,000
Health coverage
Equity (RSUs)
401(k) matching
+3
Product Manager - Developer Experience for AI Infra
Product Manager - Developer Experience for AI Infra

Baseten • San Francisco (CA)

On-site
USD 160,000 - 240,000
Competitive equity
Medical, dental & vision insurance
Flexible PTO including Winter Break
+4
AI Backend Engineer: Inference & Orchestration at Scale
AI Backend Engineer: Inference & Orchestration at Scale

Bjak • Town of Sweden (NY)

On-site
USD 120,000 - 160,000
AI Backend Engineer: Scalable Inference & Orchestration
AI Backend Engineer: Scalable Inference & Orchestration

Bjak • Town of Poland (NY)

On-site
USD 140,000 - 190,000
Scale AI Infra Engineer | Kubernetes & CI/CD
Scale AI Infra Engineer | Kubernetes & CI/CD

BaseTen • New York (NY), San Francisco (CA)

Hybrid
USD 160,000 - 210,000
Meaningful equity
100% medical, dental, vision coverage
Flexible PTO including Winter Break
+4
Developer Productivity Engineer — Inference Platform
Developer Productivity Engineer — Inference Platform

Neura Market • San Francisco (CA)

On-site
USD 180,000 - 240,000