Senior Data Engineer, Petabyte-Scale Pipelines

Wayve

United Kingdom

Hybrid

GBP 120,000 - 170,000

Full time

11 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health insurance
Equity/stake in Wayve
Relocation support

Job summary

Wayve is seeking a Senior Software Engineer, Data to join the Portal Team and scale the Data Transfer Hub, which moves petabytes of sensor data daily from partners like Uber, Stellantis and Nissan.

You will design and implement large-scale data pipelines, write Python-based pipeline logic, and manage cloud infrastructure with Terraform, Flyte for orchestration, and Azure storage. Hybrid working in multiple locations is offered.

Qualifications

  • Experience building and operating large-scale data transfer, ingestion or processing pipelines, ideally multi-terabyte or petabyte scale.
  • Strong software engineering skills with a track record of delivering and maintaining production systems.
  • Proficiency in Python and Terraform; familiarity with Flyte and other orchestration tools (Airflow/Prefect) is valuable.

Responsibilities

  • Build and operate large-scale pipelines that transfer video, LiDAR and other sensor data from global partners.
  • Shape the technical design of the Data Transfer Hub, balancing user experience, reliability, throughput, cost and partner constraints.
  • Write pipeline logic primarily in Python and manage infrastructure as code with Terraform.
  • Collaborate with product, commercial and partner-facing teams to solve real customer problems.
  • Own production systems and maintain high engineering standards as requirements evolve.
  • Participate in on-call and rotation after service establishment.

Skills

Python
Terraform
Flyte
Kafka
Azure
Airflow
Prefect
Distributed data pipelines
On-call readiness

Tools

Flyte
Kafka
Azure
Airflow
Prefect
Terraform

Job description

Wayve is seeking a Senior Software Engineer, Data to join the Portal Team and scale the Data Transfer Hub, which moves petabytes of sensor data daily from partners like Uber, Stellantis and Nissan.

You will design and implement large-scale data pipelines, write Python-based pipeline logic, and manage cloud infrastructure with Terraform, Flyte for orchestration, and Azure storage. Hybrid working in multiple locations is offered.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Platform Engineer — PB-Scale Pipelines
Senior Data Platform Engineer — PB-Scale Pipelines

EngineersOfAI • Greater London

Hybrid
GBP 90,000 - 120,000
Senior Data Engineer, Petabyte-Scale Pipelines
Senior Data Engineer, Petabyte-Scale Pipelines

Wayve • City Of London

Hybrid
GBP 90,000 - 140,000
Hybrid working
Equity
Relocation support
+1
Senior Software Engineer, Data
Senior Software Engineer, Data

EngineersOfAI • Greater London

On-site
GBP 90,000 - 120,000
Senior Data Pipeline & Orchestration Engineer
Senior Data Pipeline & Orchestration Engineer

Wayve • Greater London

On-site
GBP 90,000 - 130,000
Senior Data Pipeline Engineer — Scalable Orchestration
Senior Data Pipeline Engineer — Scalable Orchestration

Wayve • Greater London

Hybrid
GBP 90,000 - 150,000
Meaningful equity
Backend Engineer, Petabyte-Scale ML Platform
Backend Engineer, Petabyte-Scale ML Platform

Wayve • United Kingdom

Hybrid
GBP 90,000 - 120,000
Annual salary benchmarking
Equity
Relocation & visa sponsorship
+3
Senior Data & Orchestration Engineer (Hybrid)
Senior Data & Orchestration Engineer (Hybrid)

Wayve • United Kingdom

Hybrid
GBP 100,000 - 140,000
Equity participation
Relocation assistance & visa support
Hybrid working model
+2
Senior Software Engineer, Data & Orchestration
Senior Software Engineer, Data & Orchestration

Wayve • Greater London

On-site
GBP 90,000 - 130,000
Senior Data TPM Lead for AI Pipelines & Platforms
Senior Data TPM Lead for AI Pipelines & Platforms

Project Freelance • Greater London

Hybrid
GBP 90,000 - 140,000
Health insurance
Dental coverage
Enhanced parental leave
Senior Data Programme Manager - Scale AI Data Platforms
Senior Data Programme Manager - Scale AI Data Platforms

Wayve • United Kingdom

Hybrid
GBP 90,000 - 135,000
Health insurance
Hybrid working model
Learning and development budgets
+1