ML Serving Platform Engineer — Scale & Open Source

DoorDash USA; San Francisco, Sunnyvale, Seattle (CA, CA, WA); On-site; USD 131,000 - 192,000; Full time

Benefits offered by this job

Equity grants

401(k) with employer matching

Paid parental leave (16 weeks)

Medical, dental and vision benefits

Paid time off

Paid sick leave

11 paid holidays

Job summary

DoorDash seeks an experienced software engineer to advance the ML serving platform. You will connect request routing with model inference on CPU/GPU, tackle latency and scale challenges, and deliver self-service tooling for internal modelers and teams.

You will own projects end-to-end, collaborating with engineering teams to translate evolving modeling needs into reliable, scalable production features while embracing open-source innovations.

Qualifications

• 2+ years of software engineering experience building production services.
• Strong CS fundamentals and proficiency in a backend language (Java, Kotlin, Go, C++, or Python).
• Understanding of distributed systems, concurrency, networking, timeouts, and performance trade-offs.
• Ability to design, implement, test, and roll out production infrastructure.
• Experience debugging production systems using operational data to improve reliability.
• Collaborates with customers and partners to make infrastructure easier to adopt.
• Degree in Computer Science or related field, or equivalent practical experience.

Responsibilities

• Own defined projects from design through testing, rollout, and production support.
• Build tools, APIs, and workflows to deploy and operate models at scale.
• Improve routing, feature retrieval, and model execution for tens of millions of predictions per second.
• Evolve disaggregated serving architecture to scale with workloads.
• Improve Kubernetes deployment and autoscaling to meet latency and availability.
• Develop integrations and validation tooling for easy adoption.
• Monitor performance with benchmarking, profiling, and tracing; contribute to runbooks.

Skills

2+ years software engineering

Backend/Systems programming

Java

Kotlin

Go

C++

Python

Distributed systems

Debug production systems

Education

BS in Computer Science or related field

Tools

Kubernetes

Job description

DoorDash seeks an experienced software engineer to advance the ML serving platform. You will connect request routing with model inference on CPU/GPU, tackle latency and scale challenges, and deliver self-service tooling for internal modelers and teams.

You will own projects end-to-end, collaborating with engineering teams to translate evolving modeling needs into reliable, scalable production features while embracing open-source innovations.