Senior Data Engineer, Petabyte-Scale Pipelines

Wayve; City Of London; Hybrid; GBP 90,000 - 140,000; Full time

Benefits offered by this job

Hybrid working

Equity

Relocation support

Learning & development budget

Job summary

Wayve is building the cloud-based Portal Platform, enabling data exchange with partners and AI insights for autonomous driving. As Senior Software Engineer, Data, you will own production-grade data transfer hubs, using Python and Terraform to orchestrate scalable pipelines and partner integrations.

You will shape design and operations, ensure observability, and participate in on-call rotations as the service matures, while collaborating with product, commercial and partner teams across global

Qualifications

• Strong software engineering skills with production systems experience.
• Experience building large-scale data transfer, ingestion or processing pipelines.
• Proficient in Python and Terraform.
• Experience with workflow orchestration tools (Flyte preferred; Airflow/Prefect also relevant).
• Strong cloud platform skills, ideally with Azure.

Responsibilities

• Build and operate large-scale pipelines transferring video, LiDAR and sensor data from global partners.
• Shape design of the Data Transfer Hub, balancing UX, reliability, throughput, cost, and observability.

Skills

Python

Terraform

Flyte

Kafka

Airflow

Prefect

Tools

Azure

Flyte

Kafka

Airflow

Prefect

Terraform

Job description

Wayve is building the cloud-based Portal Platform, enabling data exchange with partners and AI insights for autonomous driving. As Senior Software Engineer, Data, you will own production-grade data transfer hubs, using Python and Terraform to orchestrate scalable pipelines and partner integrations.

You will shape design and operations, ensure observability, and participate in on-call rotations as the service matures, while collaborating with product, commercial and partner teams across global