Senior Software Engineer, Data & Orchestration

Wayve; Greater London; On-site; GBP 90,000 - 130,000; Full time

Job summary

Wayve is seeking a Senior Software Engineer to join the Data and Orchestration team in London. You will help build scalable data pipelines and a DAG-based orchestration system powering data ingestion, processing and inference at scale.

You will contribute to the Harness revamp, develop new infrastructure, and collaborate with partner teams to ensure reliability, performance and ease of use across the data platform.

Qualifications

• 7+ years of professional software engineering experience.
• Strong Python programming skills.
• Experience with distributed systems and large data volumes.
• Familiarity with Apache Kafka.

Responsibilities

• Design, build and evolve scalable data pipeline and orchestration infrastructure for Wayve's next-generation autonomous driving data platform.
• Contribute to the revamp of the existing Harness system and the development of a new DAG-based workflow platform.
• Build tooling and libraries that make data ingestion, processing, inference and evaluation workflows simple, reliable and consistent across teams.
• Ensure the platform can run hundreds of parallel pipeline steps efficiently, with correct outputs, no conflicts and effective resource prioritisation.
• Support batch inference and performance optimisation workflows, helping teams run evaluations in a cost-effective and scalable way.
• Improve platform reliability, quality and usability, including incident response workflows aligned to business-defined SLOs.
• Collaborate with partner teams to understand their pipeline requirements and provide the underlying infrastructure that enables them to move quickly

Skills

7+ years experience

Python

Unit testing

Distributed systems

Tools

Kafka

Postgres

ClickHouse

Job description

The role

We're looking for a Senior Software Engineer to join Wayve's Data and Orchestration team in London, working on the platforms that power our data engineering, orchestration and inference workflows at scale. This team builds the infrastructure that enables partner teams to ingest, process and transform high-volume data from external vendors, vehicle fleets and customer programmes, while ensuring systems are reliable, efficient and easy to use. A key focus for the role will be the evolution of Wayve's data pipeline platform, including the revamp of our existing Harness system and the development of a new DAG-based orchestration system designed for our vehicle fleet's next generation data volumes. You'll have the opportunity to help shape foundational infrastructure used across the company, supporting high-priority data runs, batch inference, evaluations and business-critical incident response.

Key responsibilities

• Design, build and evolve scalable data pipeline and orchestration infrastructure for Wayve's next-generation autonomous driving data platform
• Contribute to the revamp of the existing Harness system and the development of a new DAG-based workflow platform
• Build tooling and libraries that make data ingestion, processing, inference and evaluation workflows simple, reliable and consistent across teams
• Ensure the platform can run hundreds of parallel pipeline steps efficiently, with correct outputs, no conflicts and effective resource prioritisation
• Support batch inference and performance optimisation workflows, helping teams run evaluations in a cost-effective and scalable way
• Improve platform reliability, quality and usability, including incident response workflows aligned to business-defined SLOs
• Collaborate with partner teams to understand their pipeline requirements and provide the underlying infrastructure that enables them to move quickly

About you

In order to set you up for success as a Senior Software Engineer in Data and Orchestration at Wayve, we're looking for the following skills and experience.

Essential

• 7+ years of professional experience in software engineering or a related technical field.
• Strong software engineering fundamentals, with experience designing, building and maintaining production-grade systems.
• Solid Python programming skills
• Good understanding of software engineering best practices, including unit testing, integration testing, test-driven development and data-driven development
• Experience working with systems at scale, ideally involving distributed systems, large data volumes or high-throughput processing
• Familiarity with distributed event streaming platforms such as Apache Kafka
• Understanding of database principles and consistency models, including concepts such as eventual consistency, strong consistency and distributed data systems
• Familiarity with traditional databases or data warehouses such as Postgres, ClickHouse or column-oriented databases

Desirable

• Experience in data engineering, data platforms, workflow orchestration or pipeline infrastructure
• Experience with machine learning infrastructure, inference systems or ML performance optimisation
• Exposure to large-scale batch processing, compute scheduling or resource prioritisation
• Experience with tools or frameworks such as Ray, Flyte or Spark
• Experience building shared libraries, developer tooling or internal platforms used across multiple teams