Staff Software Engineer — Data Pipelines & Spark

The Trade Desk; Bellevue (NY); Hybrid; USD 206,000 - 302,000; Full time

Benefits offered by this job

Stock purchase plan

Comprehensive healthcare

401(k) with company match

Paid holidays

Job summary

The Trade Desk is seeking a Staff Software Engineer in Bellevue, WA to design, build, and maintain scalable backend data pipelines for processing massive catalogs and metadata. You will ship high-throughput workflows, RESTful services, and data integrations across platforms, collaborating with data scientists and ML engineers to productionize models.

You will work on secure APIs, data storage optimization, and reliability for systems at scale, with a focus on data quality, observability, and

Qualifications

• Bachelor's degree in Information Technology, Computer Engineering or related field.
• Five years of experience in software development or related roles.
• Three years of experience with Python, Java, or Scala; building and deploying services on cloud platforms (AWS, GCP, Azure); and operating large-scale distributed systems.
• Two years of experience with: designing data pipelines using distributed frameworks (Apache Spark); designing and implementing RESTful APIs; working with relational and NoSQL databases; data modeling and query optimization.

Responsibilities

• Design, develop, and maintain scalable backend data pipelines for processing large-scale content catalog and metadata.
• Develop and optimize high-throughput data processing workflows with Spark.
• Design and implement secure, scalable RESTful APIs for internal platforms and downstream consumers.
• Architect data integration across heterogeneous sources, ensuring data consistency and availability.
• Collaborate with data scientists and ML engineers to integrate models into production pipelines.
• Implement monitoring, observability, and reliability for data pipelines.

Education

Bachelor's degree in Information Technology, Computer Engineering or related field

Tools

Python

Java

Scala

AWS

GCP

Azure

Apache Spark

RESTful APIs

relational databases

NoSQL databases

Data modeling

Job description

The Trade Desk is seeking a Staff Software Engineer in Bellevue, WA to design, build, and maintain scalable backend data pipelines for processing massive catalogs and metadata. You will ship high-throughput workflows, RESTful services, and data integrations across platforms, collaborating with data scientists and ML engineers to productionize models.

You will work on secure APIs, data storage optimization, and reliability for systems at scale, with a focus on data quality, observability, and