Senior Data Engineer: Spark Pipelines & Scalable Backend

The Trade Desk; Bellevue (WA); Hybrid; USD 206,000 - 302,000; Full time

Benefits offered by this job

Healthcare

401(k) matching

Disability insurance

Life insurance

Well-being program

Tuition reimbursement

Parental leave

Sick time

Vacation

Paid holidays

Stock options

Incentive plan

ESOP

Job summary

The Trade Desk in Bellevue, WA is seeking a Staff Software Engineer to design and maintain scalable backend data pipelines and contribute to backend architecture.

You will work with data scientists and ML engineers, implement secure RESTful APIs, and optimize data storage and performance in a distributed cloud environment.

Qualifications include a bachelor’s degree and 5 years of experience; proficiency in Python/Java/Scala and experience with Spark and cloud platforms.

Qualifications

• Bachelor's degree in IT, Computer Engineering or related field
• 5 years of relevant experience
• 3 years in software development with Python, Java, or Scala
• Cloud platform deployment experience (AWS, GCP, Azure)
• Large-scale distributed systems operation
• 2 years experience with data pipelines, RESTful APIs, relational and NoSQL databases
• Data modeling and performance optimization

Responsibilities

• Designing and maintaining scalable backend data pipelines using Apache Spark
• Developing high-throughput data workflows
• Implementing secure RESTful APIs
• Building data integration solutions
• Collaborating with data scientists and ML engineers
• Implementing monitoring and observability for data pipelines
• Optimizing data storage and query performance
• Contributing to backend architecture
• Applying data engineering best practices

Skills

Distributed systems

Data modeling

RESTful APIs

Python/Java/Scala

Spark

Cloud platforms

Education

Bachelor's degree in IT/Computer Engineering

Tools

Apache Spark

Relational & NoSQL databases

REST APIs

AWS/GCP/Azure

Job description

The Trade Desk in Bellevue, WA is seeking a Staff Software Engineer to design and maintain scalable backend data pipelines and contribute to backend architecture.

You will work with data scientists and ML engineers, implement secure RESTful APIs, and optimize data storage and performance in a distributed cloud environment.

Qualifications include a bachelor’s degree and 5 years of experience; proficiency in Python/Java/Scala and experience with Spark and cloud platforms.