Senior Spark Platform Engineer for Scale & Reliability

DoorDash, Inc.; Sunnyvale (CA); Híbrido; USD 160.000 - 235.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

401(k) match

Paid parental leave

Wellness benefits

Commuter benefits

Paid time off

Paid sick leave

Medical benefits

Descripción de la vacante

DoorDash, Inc. is seeking a Senior Software Engineer for the Spark Platform to define architectural direction for our in-house Spark deployment that runs data, analytics, and ML workloads at scale. You will own core runtime, shuffle service, and scheduler issues and collaborate with Data Engineering, ML Platform, and product teams.

This role is hybrid and located in Bay Area or nearby hubs. You will lead platform-level improvements, mentor teams, and shape the roadmap while ensuring reliability

Formación

• 6+ years of industry experience designing and operating distributed systems at scale.
• Deep, hands-on experience with Apache Spark — internals, query execution, shuffle, and the executor/driver model, at platform scale.
• Strong fluency with Kubernetes in production and multi-tenant scheduling patterns.

Responsabilidades

• Set the long-term technical direction for the in-house Spark deployment and platform.
• Own the deepest distributed-systems challenges, including runtime, shuffle, and reliability at scale.
• Mentor and partner with managers on roadmap, hiring, and cross-team collaboration.
• Represent Spark Platform in cross-team architecture discussions and drive platform-wide standards.

Conocimientos

Distributed systems

Apache Spark

Kubernetes

Spark-on-Kubernetes

Scala

Java

Python

Go

SQL

Educación

B.S./M.S./PhD in CS

Herramientas

Apache Spark internals

Spark-on-Kubernetes operator

Descripción del empleo

DoorDash, Inc. is seeking a Senior Software Engineer for the Spark Platform to define architectural direction for our in-house Spark deployment that runs data, analytics, and ML workloads at scale. You will own core runtime, shuffle service, and scheduler issues and collaborate with Data Engineering, ML Platform, and product teams.

This role is hybrid and located in Bay Area or nearby hubs. You will lead platform-level improvements, mentor teams, and shape the roadmap while ensuring reliability