Principal Data Engineer, Datasets & Quality Pipelines

Digitailor; Sunnyvale (CA); Hybrid; USD 150,000 - 230,000; Full time

Benefits offered by this job

Equity

Relocation

Hybrid work

Learning budget

Health insurance

Pension

Job summary

Wayve is building the leading AI platform for autonomous driving, with hubs in London, Sunnyvale and beyond. We seek a senior data/software engineer who will implement and iterate data filtering, retention, and offload policies on petabyte-scale datasets, build pre-ingestion pipelines, and optimize where models run to balance compute costs and data value.

You will closely partner with data infra and storage teams, ensuring data quality reflects model training needs while shipping practical,

Qualifications

• Senior data or software engineer with Python and Spark experience.
• Experience building data ingestion and quality pipelines at scale.
• Cloud data engineering experience and strong data modelling skills.
• Ability to ship practical data solutions quickly and iteratively.

Responsibilities

• Implement and iterate filtering, retention and offload policies for large datasets.
• Build data movement pipelines for pre-ingestion selection models.
• Decide where models run to balance compute cost and data value.
• Collaborate with storage and data infra teams; monitor data quality.
• Work closely with dataset strategy lead to ship practical solutions.

Skills

Python

Spark

Cloud data eng

Data pipelines

Data quality

Tools

AWS

Airflow

Kubernetes

Job description

Wayve is building the leading AI platform for autonomous driving, with hubs in London, Sunnyvale and beyond. We seek a senior data/software engineer who will implement and iterate data filtering, retention, and offload policies on petabyte-scale datasets, build pre-ingestion pipelines, and optimize where models run to balance compute costs and data value.

You will closely partner with data infra and storage teams, ensuring data quality reflects model training needs while shipping practical,