AI Inference Platform Engineer for Production-Ready DevTools

Baseten

California

On-site

USD 165,000 - 330,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Comprehensive benefits (US)
Flexible PTO
Parental leave
Fertility stipend
401(k) plan (US)
ML startup exposure

Job summary

Baseten is seeking an engineer for the Dedicated Inference team to build and operate AI workloads in production. You will shape the developer experience across the CLI, SDKs, APIs, observability, and debugging workflows for mission-critical inference deployments.

You will work across the stack—from React components to Kubernetes Pods—while collaborating with product and forward deployed teams to drive new product ideas and improve customer outcomes.

Qualifications

  • Bachelor’s degree in Computer Science or related field or higher.
  • Proficient coding abilities in Python, Go, or JavaScript.
  • Familiarity with web applications & databases.
  • Good taste in developer-oriented tools and product sense.
  • Interest in ML/AI infrastructure and willingness to learn.
  • Strong collaboration and communication skills.

Responsibilities

  • Implement new features and products for the Dedicated Inference team.
  • Design ergonomic APIs and abstractions to solve customer problems.
  • Fix bugs and resolve customer issues with urgency.
  • Work across the stack, touching React components and Kubernetes Pods.
  • Collaborate with product and forward deployed teams to develop new ideas.

Skills

Python/Go/JavaScript
Web apps
Collaboration

Education

Bachelor’s degree in Computer Science or related field

Tools

Databases

Job description

Baseten is seeking an engineer for the Dedicated Inference team to build and operate AI workloads in production. You will shape the developer experience across the CLI, SDKs, APIs, observability, and debugging workflows for mission-critical inference deployments.

You will work across the stack—from React components to Kubernetes Pods—while collaborating with product and forward deployed teams to drive new product ideas and improve customer outcomes.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Inference Platform Engineer — Production ML Tools
AI Inference Platform Engineer — Production ML Tools

Baseten • United States

Remote
USD 140,000 - 210,000
Equity
Medical insurance
Dental & Vision
+4
Inference Platform Engineer, Production Tools & APIs
Inference Platform Engineer, Production Tools & APIs

Baseten • Seattle (WA)

On-site
USD 165,000 - 330,000
Equity
Medical/Dental/Vision insurance
Flexible PTO
+4
Senior Distributed Systems Engineer — AI Inference Platform
Senior Distributed Systems Engineer — AI Inference Platform

Baseten • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
Comprehensive medical for US
Flexible PTO
+4
Staff Inference Engineer — Production-Scale AI Platform
Staff Inference Engineer — Production-Scale AI Platform

Designworks Talent LLC • Bellevue (KY)

Hybrid
USD 180,000 - 240,000
Health insurance
401(k) plan with company match
Paid holidays
Forward-Deployed AI Inference Engineer
Forward-Deployed AI Inference Engineer

BaseTen • New York (NY), San Francisco (CA)

Hybrid
USD 140,000 - 210,000
Equity
Healthcare coverage
Flexible PTO & Winter Break
+4
Distributed Systems Engineer — AI Inference Platform
Distributed Systems Engineer — AI Inference Platform

Baseten • New York (NY)

On-site
USD 180,000 - 360,000
Competitive compensation with equity
Medical, dental, and vision coverage
Flexible PTO with Winter Break
+4
Senior Inference Engineer: Build Production-Grade AI APIs
Senior Inference Engineer: Build Production-Grade AI APIs

AssemblyAI, Inc. • Washington

On-site
USD 190,000 - 225,000
Software Engineer- Inference Platform
Software Engineer- Inference Platform

Baseten • United States

Remote
USD 180,000 - 240,000
AI Inference & Platform Marketing Lead
AI Inference & Platform Marketing Lead

Baseten • United States

Remote
USD 170,000 - 230,000
Remote-first work environment
In-person team summits
Unlimited PTO
+4
Senior Platform Testing Engineer for AI Inference
Senior Platform Testing Engineer for AI Inference

Baseten • San Francisco (CA)

On-site
USD 165,000 - 330,000
Equity
Medical, dental, and vision insurance
Flexible PTO (Winter Break)
+3