Distributed Systems Engineer, AI Inference Platform

Baseten

United States

Remote

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote-friendly
Home-office stipend
Healthcare coverage
Paid parental leave
401(k)

Job summary

Baseten in the United States is hiring distributed systems engineers and product-minded generalists to build the distributed runtime powering large-scale LLM inference on Baseten. You’ll own end-to-end projects spanning architecture, deployment, monitoring, and iteration on customer feedback to deliver fast, reliable, and cost-efficient inference at scale.

You’ll work across the stack—from the developer experience customers use to deploy models, through Model APIs and tooling, down to the

Job description

Baseten in the United States is hiring distributed systems engineers and product-minded generalists to build the distributed runtime powering large-scale LLM inference on Baseten. You’ll own end-to-end projects spanning architecture, deployment, monitoring, and iteration on customer feedback to deliver fast, reliable, and cost-efficient inference at scale.

You’ll work across the stack—from the developer experience customers use to deploy models, through Model APIs and tooling, down to the

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Distributed Systems Engineer — AI Inference Platform
Distributed Systems Engineer — AI Inference Platform

Baseten • New York (NY)

On-site
USD 180,000 - 360,000
Competitive compensation with equity
Medical, dental, and vision coverage
Flexible PTO with Winter Break
+4
Distributed Systems Engineer for LLM Inference Platform
Distributed Systems Engineer for LLM Inference Platform

Baseten • San Francisco (CA)

On-site
USD 180,000 - 360,000
Competitive equity
Medical insurance
Flexible PTO
+4
Senior Distributed Systems Engineer — AI Inference Platform
Senior Distributed Systems Engineer — AI Inference Platform

Baseten • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
Comprehensive medical for US
Flexible PTO
+4
Distributed Systems Engineer - LLM Inference Platform
Distributed Systems Engineer - LLM Inference Platform

US Health Partners, LLC • New York (NY)

Hybrid
USD 150,000 - 210,000
Equity and competitiveness
US benefits: medical/dental/vision for
Flexible PTO
+3
Inference Platform Engineer, Production Tools & APIs
Inference Platform Engineer, Production Tools & APIs

Baseten • Seattle (WA)

On-site
USD 165,000 - 330,000
Equity
Medical/Dental/Vision insurance
Flexible PTO
+4
Software Engineer- Inference Platform
Software Engineer- Inference Platform

US Health Partners, LLC • New York (NY)

Hybrid
USD 150,000 - 210,000
Equity and competitiveness
US benefits: medical/dental/vision for
Flexible PTO
+3
Software Engineer - Inference Platform
Software Engineer - Inference Platform

Baseten • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
Comprehensive medical for US
Flexible PTO
+4
Software Engineer- Inference Platform
Software Engineer- Inference Platform

Candidate • San Francisco (CA)

On-site
USD 170,000 - 210,000
Equity
Medical insurance
Flexible PTO
+3
Backend Platform Engineer - AI Inference & Scale
Backend Platform Engineer - AI Inference & Scale

present of AI • San Francisco (CA)

On-site
USD 140,000 - 200,000
Software Engineer- Inference Platform
Software Engineer- Inference Platform

Baseten • San Francisco (CA)

On-site
USD 180,000 - 360,000
Competitive equity
Medical insurance
Flexible PTO
+4