Staff Engineer: Autonomous Driving Data Platform & Curation

CARIAD, Inc.; Mountain View (CA); Hybrid; USD 162,000 - 234,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401k match

Disability insurance

Life insurance

AD&D insurance

Tuition reimbursement

Student loan repayment

Paid time off

Vehicle lease program

Job summary

CARIAD, Inc. in Mountain View, CA is seeking a Staff Engineer to own the path from raw multimodal vehicle data to ready datasets. You’ll lead ingestion, schema, storage, and curation for 10M+ records, enabling efficient retrieval and model-ready data for autonomous driving.

The role requires deep ML/data engineering expertise, experience with Parquet/Lance/Arrow, and ability to design scalable pipelines, governance, and observability across cloud storage and on-prem systems.

Qualifications

• 8+ years of experience in applied machine learning or deep learning.
• 4+ years of experience in reinforcement learning, computer vision, or AD/ADAS systems.
• Master’s in Computer Science, Robotics, Electrical Engineering, Applied Mathematics, or a related field.
• PhD in Computer Science, Robotics, Electrical Engineering, Applied Mathematics, or a related field.

Responsibilities

• Design canonical representations for drives, scenarios, frames, trajectories, and dataset manifests.
• Build and maintain validated, versioned datasets containing 10M+ records on local or cloud storage.
• Evaluate Parquet, Apache Arrow, Lance; own partitioning, indexing, schema evolution, lineage, and reproducibility.
• Optimize filtering, projection, joins, scenario slicing, and data-loading performance.
• Measure and improve ingestion throughput, query latency, storage utilization, and cost per usable sample.
• Lead data quality monitoring, labeling workflows, and reproducibility across teams.

Skills

Autonomous driving data

Production data pipelines

Python

SQL

Parquet/Lance/Arrow

Education

Master's in Computer Science, Robotics, Electrical Engineering, Applied Mathematics, or related field

Tools

Parquet

Lance

Apache Arrow

Spark

Beam

Airflow

Job description

CARIAD, Inc. in Mountain View, CA is seeking a Staff Engineer to own the path from raw multimodal vehicle data to ready datasets. You’ll lead ingestion, schema, storage, and curation for 10M+ records, enabling efficient retrieval and model-ready data for autonomous driving.

The role requires deep ML/data engineering expertise, experience with Parquet/Lance/Arrow, and ability to design scalable pipelines, governance, and observability across cloud storage and on-prem systems.