Software Engineer, Data Engineering Mid

D8 LooP; Sunnyvale (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

DoorDash is seeking a Software Engineer for Data Engineering in the San Francisco Bay Area, including Sunnyvale and Seattle. You will design, build and optimize scalable data pipelines, data models and data warehouse architectures to support reporting, product analytics and financial reporting.

You will use Python and SQL with Spark for large-scale processing, and work on streaming workloads with Kafka and Flink.

Qualifications

• 3+ years in data engineering or equivalent experience.
• Experience with ETL orchestration and workflow management tools.
• Proficiency in Python and SQL for data processing.
• Strong knowledge of Spark and distributed data systems.
• Experience with streaming platforms and data warehousing.

Responsibilities

• Design and implement large-scale data pipelines and data models.
• Collaborate on data lake and data warehouse architectures.
• Ensure data quality and monitoring across pipelines.

Skills

Python

SQL

Spark

Streaming technologies

Tools

Airflow

Flink

Oozie

Azkaban

Kafka

Tableau

Looker

Superset

Job description

Software Engineer, Data Engineering

San Francisco, CA; Sunnyvale, CA; Seattle, WA Mid 3+ yrs Data Engineer posted 3 d ago

Data is at the foundation of DoorDash success. The Data Engineering team builds database solutions for various use cases including reporting, product analytics, marketing optimization and financial reporting. By implementing pipelines, data structures, and data warehouse architectures;

Skills, with evidence

• Airflow / orchestration 3+ years of experience in ETL orchestration and workflow management tools like Airflow, Flink, Oozie and Azkaban using AWS/GCP must have
• Develop and implement data quality checks, conduct QA and implement monitoring routines must have
• Python Proficiency in programming languages such as Python/Java must have
• SQL Expert in Database fundamentals, SQL and distributed computing must have
• Spark 3+ years of experience with the Distributed data/similar ecosystem (Spark, Hive, Druid, Presto) and streaming technologies such as Kafka/Flink. must have
• AWS 3+ years of experience in ETL orchestration and workflow management tools like Airflow, Flink, Oozie and Azkaban using AWS/GCP must have · not practised here
• GCP 3+ years of experience in ETL orchestration and workflow management tools like Airflow, Flink, Oozie and Azkaban using AWS/GCP must have · not practised here
• Streaming 3+ years of experience in ETL orchestration and workflow management tools like Airflow, Flink, Oozie and Azkaban using AWS/GCP
• Warehousing By implementing pipelines, data structures, and data warehouse architectures;
• Design, develop and implement large scale, high volume, high performance data models and pipelines for Data Lake and Data Warehouse
• Knowledge of reporting tools such as Tableau, Superset and Looker not practised here
• Governance & security That’s why we offer a comprehensive benefits package to all regular employees, which includes a 401(k) plan with employer matching, 16 weeks of paid parental leave, wellness benefits, commuter benefits match, paid time off and paid sick leave in compliance with applicable laws (e.g. not practised here