Senior Software Engineer, Data

Wayve; London (KY); Hybrid; USD 119,000 - 172,000; Full time

Job summary

Wayve is seeking a Senior Software Engineer, Data to build the Data Transfer Hub, a globally distributed system for PB-scale sensor data exchange with partners. You will design and operate data pipelines across video, LiDAR and other sensor data, using Flyte, Kafka, and Azure technologies.

You will join a small, autonomous team in London, contributing to architecture, reliability and observability while maintaining high engineering standards in a fast-changing environment.

Qualifications

• Proven experience building and operating large-scale data transfer, ingestion or data processing pipelines, ideally at multi-TB or PB scale.
• Strong software engineering skills and production systems delivery experience.
• Experience with workflow orchestration for parallelised jobs (Flyte preferred; other tools also relevant).
• Experience building reliable, observable data systems with retry, backfills, data integrity checks and alerting.
• Strong cloud skills, Azure preferred; AWS/GCP a plus.
• Proficiency in Python and Terraform.
• Experience with blob/object storage, large-scale file movement, networking or cloud-to-cloud data transfer.
• Product mindset: focus on customer problems and deliver real value.
• Comfort in fast-changing environments and ownership mentality.

Responsibilities

• Build and operate large-scale data transfer pipelines for video, LiDAR and sensor data from global partners at PB/day scale.
• Contribute to Data Transfer Hub design, balancing UX, throughput, cost and observability.
• Develop distributed pipelines using Flyte, Kafka/event-driven patterns, and Azure storage/infrastructure.
• Implement hub-and-spoke data transfer model for global data sharing with partners.
• Write infrastructure-as-code in Terraform and pipeline logic in Python.
• Create reliable operational foundations including retries, backfills, data integrity checks and dashboards.

Skills

Data pipelines

Python

Terraform

Azure

Observability

Production systems

Cloud platforms

Ownership

Fast-changing environment

Tools

Flyte

Kafka

Airflow

Prefect

Job description

The role

Portal is the cloud platform that connects Wayve to the outside world: handling data exchange with partners, surfacing AI insights, and enabling the commercial deployment of Wayve's AI driver on vehicles across the globe.

We're looking for a Senior Software Engineer, Data to help build Wayve's Data Transfer Hub: a mission-critical piece of infrastructure that will scale to transfer petabytes of sensor data per day from partners covering vehicles around the world.

This is a pivotal project at Wayve. You'll work as part of a small, high-autonomy team building a globally distributed hub-and-spoke data exchange system, working with partners like Uber, Stellantis and Nissan. Your work will help make Wayve's AI model training possible at scale.

Key responsibilities:

• Build and operate large-scale data transfer pipelines for video, LiDAR and sensor data from global partners at up to PB/day scale

• Contribute to the technical design of the Data Transfer Hub, making pragmatic trade-offs across UX, careliability, throughput, cost, partner constraints, observability and operational support

• Build parallelised, distributed data transfer pipelines using Flyte for workflow orchestration, Kafka/event-driven patterns for lifecycle tracing, and Azure for storage and transfer infrastructure

• Help implement and evolve a globally distributed hub-and-spoke data transfer model to retrieve and share sensor data at scale with partners

• Write infrastructure-as-code in Terraform and pipeline logic primarily in Python

• Build reliable operational foundations, including retry strategies, backfills, data integrity checks, lifecycle/state tracking, dashboards and alerting

• Work on cloud-to-cloud and cross-cloud networking solutions, with Azure as the primary cloud platform

• Once established, participate in an out-of-hours on-call and support rotation.

• Collaborate with product, commercial and partner-facing teams to understand constraints and deliver solutions that solve real customer and partner problems

• Work in a fast-changing environment where requirements and partner deliverable dates evolve, while maintaining high engineering standards

About you

In order to set you up for success as a Senior Software Engineer at Wayve, we’re looking for the following skills and experience.

Essential

• Proven experience building and operating large-scale data transfer, ingestion or data processing pipelines, ideally at multi-TB or PB scale

• Strong software engineering skills

• Experience delivering & maintaining production systems

• Experience with workflow orchestration for parallelised jobs; Flyte preferred, but Airflow, Prefect or similar tools are also relevant

• Experience building reliable, observable data systems, including retry strategies, backfills, data integrity checks, lifecycle/state tracking and operational alerting

• Strong cloud platform skills, with Azure preferred; experience with AWS or GCP is a plus

• Proficiency in Python and Terraform

• Experience with blob/object storage, large-scale file movement, networking or cloud-to-cloud data transfer

• A product mindset: you think about the customer and build solutions that fix real problems, not just implement requirements

• Comfort working in a fast-changing environment with evolving requirements

• A strong sense of ownership: you take responsibility for outcomes, communicate clearly, and help the team move quickly

Desirable

• Experience working with external data partners or customer-facing technical integrations

• Background in autonomous vehicles, robotics, geospatial data, video processing or other data-intensive domains

• Experience with Kafka or other event-driven systems for transfer observability and lifecycle tracking

• Experience building dashboards to communicate transfer job status

• Multi-cloud experience across Azure, AWS and/or GCP

• Experience improving cost efficiency, throughput or reliability of large-scale cloud data systems

This is a full-time role based in our office in London. At Wayve we want the best of all worlds so we operate a hybrid working policy that combines time together in our offices and workshops to fuel innovation, culture, relationships and learning, and time spent working from home.