Senior Data & Orchestration Engineer (Python, Scale)

Wayve Technologies Ltd.; Greater London; Híbrido; GBP 85.000 - 135.000; Jornada completa

Descripción de la vacante

Wayve in London is seeking a Senior Software Engineer for the Data and Orchestration team to build and evolve the data pipeline platform, ingesting and processing high-volume data from external vendors and vehicle fleets, while ensuring reliability and scalability.

You will revamp Harness and help design a new DAG-based system for next-generation data volumes, enabling batch inference, evaluations and incident response across partner teams.

Formación

• 7+ years of professional software engineering experience.
• Strong fundamentals and production-grade systems.
• Solid Python programming skills.
• Experience with large-scale systems and distributed processing.
• Familiarity with Apache Kafka.
• Knowledge of databases like Postgres or ClickHouse.

Responsabilidades

• Design and evolve scalable data pipelines and orchestration infra.
• Revamp Harness and develop a new DAG-based workflow platform.
• Build tooling to standardize ingestion, processing, inference and evaluation.
• Ensure hundreds of parallel pipeline steps run reliably with correct outputs.
• Support batch inference and cost-effective evaluations.
• Improve platform reliability and incident response aligned to SLOs.
• Collaborate with partner teams to understand pipeline needs.

Conocimientos

Python

Distributed systems

Kafka

Postgres

ClickHouse

Unit testing

TDD

Herramientas

Ray

Flyte

Spark

Descripción del empleo

Wayve in London is seeking a Senior Software Engineer for the Data and Orchestration team to build and evolve the data pipeline platform, ingesting and processing high-volume data from external vendors and vehicle fleets, while ensuring reliability and scalability.

You will revamp Harness and help design a new DAG-based system for next-generation data volumes, enabling batch inference, evaluations and incident response across partner teams.