Senior Backend Data Engineer — Scalable Streaming Pipelines

Thetradedesk; San Jose (CA); On-site; USD 124,900 - 228,900; Full time

Benefits offered by this job

Comprehensive healthcare benefits

401k plan with company match

Employee Stock Purchase Plan

Generous vacation and sick leave

Job summary

The Trade Desk is seeking a Data Engineer to join our innovative team in San Jose, California. In this role, you'll design and maintain data pipelines for the Ventura OS project and develop workflows to handle large-scale data effectively. Our ideal candidate thrives in a high-scale environment and is eager to solve complex challenges.

We offer a competitive benefits package and an inclusive culture that values diversity and innovation. If you have extensive experience with data warehousing solutions, data governance frameworks, and big data technologies, we'd love to hear from you.

Qualifications

• 7+ years of software development experience, focusing on data engineering or pipeline development.
• Ability to learn quickly and tackle complex problems with innovative solutions.
• Effective communication skills for technical and non-technical stakeholders.

Responsibilities

• Design and maintain data pipelines for the Ventura OS project.
• Develop data processing workflows for large-scale data.
• Create APIs to expose secure data services.
• Collaborate and integrate models with data scientists.

Skills

Data warehousing solutions

Data governance and quality frameworks

Machine learning pipelines and MLOps

Content metadata processing

AI-driven content surfacing

Data modeling concepts

Big data technologies

Programming skills in Java, Scala, or Python

Education

Bachelor's or Master's degree in Computer Science, Engineering, or related field

Tools

Apache Spark

Kafka

AWS

GCP

Azure

Kubernetes

Job description

The Trade Desk is seeking a Data Engineer to join our innovative team in San Jose, California. In this role, you'll design and maintain data pipelines for the Ventura OS project and develop workflows to handle large-scale data effectively. Our ideal candidate thrives in a high-scale environment and is eager to solve complex challenges.

We offer a competitive benefits package and an inclusive culture that values diversity and innovation. If you have extensive experience with data warehousing solutions, data governance frameworks, and big data technologies, we'd love to hear from you.