Inference Platform Engineer, Production Tools & APIs

Baseten

Seattle (WA)

On-site

USD 165,000 - 330,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Medical/Dental/Vision insurance
Flexible PTO
Parental leave
Fertility stipend
401(k)
ML startup exposure

Job summary

Baseten is hiring an Engineer for the Dedicated Inference team to shape developer experience for deploying and operating AI workloads in production. You’ll build CLI, SDKs, APIs, observability, and debugging workflows that customers rely on daily to manage inference deployments.

The role sits within Dedicated Inference, a high-visibility team at Baseten that shapes new products for key customers and expands capacity to support mission-critical AI workloads.

Qualifications

  • Bachelor's degree is required.
  • Proficient in Python, Go, or JavaScript; proficiency in one is a plus.
  • Familiarity with web applications and databases.

Responsibilities

  • Implement new features and products for the team.
  • Design ergonomic APIs and abstractions to solve customer problems.
  • Fix bugs and resolve customer issues with urgency.
  • Work across the stack; you will touch React components and Kubernetes pods.
  • Collaborate with product and forward-deployed teams to develop and drive new ideas.

Skills

Python
Go
JavaScript

Education

Bachelor's degree in Computer Science or related field

Job description

Baseten is hiring an Engineer for the Dedicated Inference team to shape developer experience for deploying and operating AI workloads in production. You’ll build CLI, SDKs, APIs, observability, and debugging workflows that customers rely on daily to manage inference deployments.

The role sits within Dedicated Inference, a high-visibility team at Baseten that shapes new products for key customers and expands capacity to support mission-critical AI workloads.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Inference Platform Engineer for Production-Ready DevTools
AI Inference Platform Engineer for Production-Ready DevTools

Baseten • California

On-site
USD 165,000 - 330,000
Equity
Comprehensive benefits (US)
Flexible PTO
+4
AI Inference Platform Engineer — Production ML Tools
AI Inference Platform Engineer — Production ML Tools

Baseten • United States

Remote
USD 140,000 - 210,000
Equity
Medical insurance
Dental & Vision
+4
Distributed Systems Engineer — AI Inference Platform
Distributed Systems Engineer — AI Inference Platform

Baseten • New York (NY)

On-site
USD 180,000 - 360,000
Competitive compensation with equity
Medical, dental, and vision coverage
Flexible PTO with Winter Break
+4
Forward-Deployed AI Inference Engineer
Forward-Deployed AI Inference Engineer

BaseTen • New York (NY), San Francisco (CA)

Hybrid
USD 140,000 - 210,000
Equity
Healthcare coverage
Flexible PTO & Winter Break
+4
Software Engineer- Inference Platform
Software Engineer- Inference Platform

Baseten • United States

Remote
USD 180,000 - 240,000
Senior Distributed Systems Engineer — AI Inference Platform
Senior Distributed Systems Engineer — AI Inference Platform

Baseten • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
Comprehensive medical for US
Flexible PTO
+4
Software Engineer - Dedicated Inference
Software Engineer - Dedicated Inference

Baseten • Seattle (WA)

On-site
USD 165,000 - 330,000
Equity
Medical/Dental/Vision insurance
Flexible PTO
+4
Software Engineer - Dedicated Inference
Software Engineer - Dedicated Inference

Baseten • California

On-site
USD 165,000 - 330,000
Equity
Comprehensive benefits (US)
Flexible PTO
+4
Distributed Systems Engineer for AI Inference Platform
Distributed Systems Engineer for AI Inference Platform

Baseten • United States

Remote
USD 180,000 - 240,000
Senior Platform Testing Engineer for AI Inference
Senior Platform Testing Engineer for AI Inference

Baseten • San Francisco (CA)

On-site
USD 165,000 - 330,000
Equity
Medical, dental, and vision insurance
Flexible PTO (Winter Break)
+3