Autonomy Data Engineer II — Pipelines & Data Lakes

Torc Robotics; United States; Remote; USD 139,000 - 167,000; Full time

Benefits offered by this job

Bonus component & stock options

Medical/Dental/Vision coverage

401K with employer match

Flexible schedule & paid vacation

Holiday office closures

AD&D & Life Insurance

Job summary

Torc Robotics is seeking an Autonomy Data Engineer Level 2 to design, build, and operate the data infrastructure powering our autonomy program. You will create data lakes, ingestion pipelines, and labeling tooling for high-bandwidth sensor logs used by perception, planning and simulation teams.

This is a high-ownership role on a lean team, moving large-scale sensor data from vehicles to cloud storage, building validations, and dashboards to monitor data coverage across terrain and environments.

Qualifications

• Bachelor’s degree in CS/CE/EE or related field with 4+ years data engineering experience
• Strong proficiency in Python and SQL, with ability to build production-quality data pipelines
• Experience with cloud data infrastructure (AWS) and infrastructure-as-code tools (Terraform, CloudFormation)
• Understanding of data partitioning and columnar formats (Parquet, ORC)
• Experience building data pipelines for time-series and binary data
• Ability to evaluate open-source tooling vs building in-house
• Commitment to data quality with monitoring, validation and lineage tracking

Responsibilities

• Design and organize the program’s data lake, including schema, partitioning, and metadata indexing
• Build end-to-end pipelines that ingest high-bandwidth sensor logs to cloud storage with high reliability
• Implement data validation and integrity checks before downstream processing
• Implement retention, tiering and lifecycle policies to balance storage and value
• Build tooling to query raw logs to produce curated training/evaluation datasets
• Automate pseudo-labeling at data ingest scale
• Develop data quality metrics to direct labeling effort toward high-value examples
• Deploy and maintain data visualization tooling for log review and QA workflows
• Create dashboards to show data coverage by terrain, environment, and region
• Define data contracts and collaborate with model training and engineering teams
• Evolve data engineering standards and tooling; surface findings to leadership

Skills

Python

SQL

AWS

Terraform

Data pipelines

Time-series data

Education

Bachelor’s degree in Computer Science, Computer Engineering, Software Engineering, Electrical Engineering or related field

Tools

Foxglove

Rerun

MCAP CLI

Job description

Torc Robotics is seeking an Autonomy Data Engineer Level 2 to design, build, and operate the data infrastructure powering our autonomy program. You will create data lakes, ingestion pipelines, and labeling tooling for high-bandwidth sensor logs used by perception, planning and simulation teams.

This is a high-ownership role on a lean team, moving large-scale sensor data from vehicles to cloud storage, building validations, and dashboards to monitor data coverage across terrain and environments.