Engineering Manager - Data Ingest & Analysis (Model Dev Platform)

Wayve; City Of London; On-site; GBP 80,000 - 100,000; Full time

Job summary

A leading technology company in the UK is looking for an Engineering Manager to oversee the Data Ingest & Analysis team. This role involves leading a multidisciplinary group responsible for managing and processing vast amounts of driving data critical for training AI in autonomous vehicles. Candidates should possess strong leadership skills, software engineering expertise, and experience with large-scale data operations. The position offers a unique opportunity to contribute to innovative solutions in the field of autonomous driving.

Qualifications

• Strong experience in managing teams focused on data or platform engineering.
• Hands-on experience building ETL workflows.
• Proven ability to deliver software solutions for petabyte-scale data processing.

Responsibilities

• Lead a team managing data ingestion and processing workflows.
• Optimize large-scale data processing pipelines.
• Ensure reliable operations of workflows for data training.

Skills

Leadership

Software engineering

Data operations

Strategic planning

Communication

Mentorship

Education

Degree in Computer Science, Electrical Engineering, or related field

Tools

Apache Spark

Flyte

Job description

Overview

At Wayve we're committed to creating a diverse, fair and respectful culture that is inclusive of everyone based on their unique skills and perspectives, and regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, veteran status, pregnancy or related condition (including breastfeeding) or any other basis as protected by applicable law.

Founded in 2017, Wayve is the leading developer of Embodied AI technology. Our advanced AI software and foundation models enable vehicles to perceive, understand, and navigate any complex environment, enhancing the usability and safety of automated driving systems. Our vision is to create autonomy that propels the world forward. Our intelligent, mapless, and hardware-agnostic AI products are designed for automakers, accelerating the transition from assisted to automated driving.

In our fast-paced environment big problems ignite us—we embrace uncertainty, leaning into complex challenges to unlock groundbreaking solutions. We aim high and stay humble in our pursuit of excellence, constantly learning and evolving as we pave the way for a smarter, safer future. At Wayve, your contributions matter. We value diversity, embrace new perspectives, and foster an inclusive work environment; we back each other to deliver impact. Make Wayve the experience that defines your career!

The Role

Wayve's efforts to develop our autonomous-driving AI starts with the Data Ingest & Analysis team. As its Engineering Manager, you will lead a multidisciplinary group that moves and processes hundreds of petabytes of multimodal driving data—the fuel that trains our end-to-end driving model. Without fast, reliable, and scaled access to driving data, the model cannot learn. Your leadership ensures every training job starts with the right bytes at the right time. Success in this role will have a far-reaching impact, ensuring that Wayve has access to the data needed to train our AI model.

Challenges You Will Own

The Data Ingest & Analysis team own the very first step on Wayve's process of developing its autonomous driving software: the collect, transformation, and analysis of the hundreds of petabytes of driving data used to train our AI to drive vehicles. As the Engineering Manager of this team, you will:

1. Team Leadership and Strategic Oversight
   • Build and lead a team of data and platform engineers.
   • Define and execute the team's roadmap in collaboration with stakeholders from the AI and Vehicle Software organizations.
   • Set clear objectives, foster collaboration, and ensure timely delivery of projects.
2. Architecture of Petabyte Scale Data Processing
   • Manage and optimize large-scale Spark-based map-reduce data processing pipelines.
   • Oversee large scale transcoding and processing workflows to ensure data is ready for AI training.
3. Ingestion of Hundreds of Petabytes of Data
   • Enable the collection of driving data from a large number of internal and third-party data sources.
   • Normalize collected data to a consistent schema as needed by Wayve's AI training process.
4. Ensure Reliable Operations of Workflow
   • Leverage work scheduling tools like Flyte to orchestrate multi-faceted data process workflow.
   • Build and leverage operational observability to understand status of reliable operations.
   • Set up processes to enable 24/7 reliable operations of workflow.
5. Technical Mentorship and Talent Development
   • Recruit, mentor, and grow your team, cultivating technical excellence.
   • Identify skill gaps and facilitate training to meet the evolving needs of the team.

What We Are Looking For in Our Candidate

Essential:

• Proven Leadership: Strong experience in software engineering with experience managing teams focused on data or platform engineering.
• Technical Expertise: Hands-on experience with building ETL workflows in Apache Spark or inferencing workflows orchestrated by Flyte, or comparable technologies.
• Experience in Large Scale Data Operations: Demonstrated ability to deliver software solutions that enable collection and processing of petabytes of data.
• Strategic Acumen: Proven ability to define, negotiate, and execute technical roadmaps.
• Collaborative Abilities: Exceptional communication skills to effectively liaise with AI developers, infrastructure engineers, and other stakeholders.
• Talent Development: Strong ability to identify, recruit, mentor, develop, and retain top talent.
• Educational Background: A degree in Computer Science, Electrical Engineering, or a related field.

Desirable:

• Data Warehouse / Datalake Management: Experience with organising petabyte-scale data sets for use by a wide variety of users.
• Heterogeneous Data Processing: Experience combining Apache Spark with other data processing technologies to produce a multi-faceted workflow for normalizing, labeling, and analyzing data.
• Educational Excellence: A Master’s degree or higher in Computer Science, Electrical Engineering, or a related discipline.

This role offers a unique opportunity to provide the software and data foundation of Wayve's autonomous vehicles, ensuring innovation, reliability, and scaled access to data as we shape the future of mobility.

We understand that everyone has a unique set of skills and experiences and that not everyone will meet all of the requirements listed above. If you're passionate about self-driving cars and think you have what it takes to make a positive impact on the world, we encourage you to apply.

For more information visit Careers at Wayve.

To learn more about what drives us, visit Values at Wayve

Disclaimer: We will not ask about marriage or pregnancy, care responsibilities or disabilities in any of our job adverts or interviews. However, we do look to capture information about care responsibilities, and disabilities among other diversity information as part of an optional DEI Monitoring form to help us identify areas of improvement in our hiring process and ensure that the process is inclusive and non-discriminatory.