Senior Data Engineer, Autonomous Driving Data Pipelines

Toyota Research Institute Inc.; Los Altos (CA); On-site; USD 180,000 - 270,000; Full time

Job summary

Toyota Research Institute is seeking a Senior Data Engineer to design and build the data infrastructure powering our autonomy research. You will create scalable ingestion pipelines, feature stores, labeling tools, and data discovery services for vehicle and simulation data, collaborating with ML researchers and engineers.

You will optimize pipelines for cost, latency, and reproducibility, work with cloud platforms like AWS, and help advance end-to-end ML workflows from data to model evaluation

Qualifications

• Bachelor’s or Master’s degree in CS, Data Eng, or related field.
• 8+ years building data-intensive software systems in robotics, autonomous driving, or large-scale ML environments.
• Proficient in Python and SQL; familiar with C++.
• Experience designing ETL pipelines using Spark, Flyte, Union.
• Strong knowledge of cloud-native architectures, including AWS services (S3).
• Familiarity with sensor data types and common data serialization formats.
• Deep understanding of data quality, observability, and lineage in high-volume systems.
• Track record of building reliable and performant infrastructure for ad-hoc exploration and production workflows.

Responsibilities

• Design scalable data ingestion, transformation, storage, and retrieval pipelines.
• Build internal tools for data labeling, curation, indexing, and cataloging.
• Collaborate with ML researchers, autonomy engineers, and data scientists on model training and evaluation.
• Develop and maintain feature stores, metadata systems, and versioning for data.
• Support synthetic datasets alongside real-world logs for hybrid training and simulation workflows.
• Optimize pipelines for cost, latency, and traceability across environments.
• Partner with simulation and cloud platform teams to automate workflows for testing and analytics.

Skills

Python

SQL

C++

Education

Bachelor’s or Master’s degree in CS/Data Engineering or related field

Tools

Apache Spark

Flyte

Union

AWS S3

Job description

Toyota Research Institute is seeking a Senior Data Engineer to design and build the data infrastructure powering our autonomy research. You will create scalable ingestion pipelines, feature stores, labeling tools, and data discovery services for vehicle and simulation data, collaborating with ML researchers and engineers.

You will optimize pipelines for cost, latency, and reproducibility, work with cloud platforms like AWS, and help advance end-to-end ML workflows from data to model evaluation