ML Serving Platform Engineer - Scale & Self-Serve

Doordashusa; San Francisco, Sunnyvale, Seattle (CA, CA, WA); On-site; USD 131,000 - 192,000; Full time

Benefits offered by this job

Benefits package

401(k) matching

Parental leave

Job summary

DoorDash’s ML Serving Platform is seeking an engineer to help shape the next generation of our serving infrastructure. You will connect request routing and online feature retrieval with model inference across CPU and GPU fleets, tackling latency, reliability, and scale with self-serve tooling.

You’ll own projects end-to-end, collaborate with modeling teams to translate requirements into robust designs, and drive production adoption of open source innovations and efficient distributed services.

Qualifications

• 2+ years of software engineering experience building and maintaining production services or infrastructure.
• Strong computer science fundamentals and proficiency in a backend or systems programming language such as Java, Kotlin, Go, C++, or Python.
• Understanding of distributed systems, including concurrency, networking, timeouts, failure handling, and performance trade-offs.
• Ability to translate a defined problem into a technical design, implementation, and production rollout.
• Experience debugging production systems and using operational data to improve reliability, performance, or cost.
• Focus on making it easy for engineers to adopt and use the platform.
• Degree in Computer Science or a related field, or equivalent practical experience.

Responsibilities

• Own defined projects from technical design and implementation through testing, rollout, and production support.
• Partner with internal teams to understand evolving modeling requirements and remove adoption barriers.
• Turn advances in open source technology into measurable production improvements.
• Build self-serve tooling, APIs, and workflows to deploy, configure, validate, and operate models.
• Improve routing, feature retrieval, and model execution to scale with workloads.
• Enhance Kubernetes deployment and autoscaling to meet latency and availability targets.

Skills

Software engineering

Backend development

Distributed systems

Debugging prod systems

CS fundamentals

Programming languages: Java/Kotlin/Go/

Education

Bachelor's degree in CS or related field

Tools

Kubernetes

Open source experience

Job description

DoorDash’s ML Serving Platform is seeking an engineer to help shape the next generation of our serving infrastructure. You will connect request routing and online feature retrieval with model inference across CPU and GPU fleets, tackling latency, reliability, and scale with self-serve tooling.

You’ll own projects end-to-end, collaborate with modeling teams to translate requirements into robust designs, and drive production adoption of open source innovations and efficient distributed services.