Senior Software Engineer - Data Infrastructure

Woven by Toyota; Greater London; On-site; GBP 70,000 - 110,000; Full time

Benefits offered by this job

Health and dental coverage

Pension plan

Flexible vacation policy

Family planning and care benefits

Job summary

Woven by Toyota’s London Data Infrastructure team builds and scales data pipelines for autonomous driving data. You will design and implement distributed data systems, focusing on reliability and performance, using Python and cloud technologies across AWS/GCP/Azure.

You will collaborate with ML and CV engineers, own critical data workflows, and mentor junior engineers while shaping the roadmap for our data platforms in a fast-paced mobility environment.

Qualifications

• Proven track record building data pipelines and data platforms.
• Experience with distributed data processing and ML data flows.
• Strong Python coding and testable modular code.
• Experience with Flyte or similar workflow orchestration preferred.
• Experience collaborating across teams and disciplines.

Responsibilities

• Develop and optimize data pipelines for ingestion from the vehicle data fleet.
• Build and maintain scalable data infrastructure in the cloud.
• Collaborate with ML and Computer Vision teams on data needs.
• Mentor junior engineers in day-to-day projects.
• Contribute to long-term strategy for data products.

Skills

Python

Distributed systems

Data infrastructure

Data pipelines

Cloud computing

Mentoring

Education

Bachelor's or higher in CS/SE or related field

Tools

Flyte

Kafka

SQS

BigQuery

ElasticSearch

AWS

GCP

Azure

Job description

Woven by Toyota is enabling Toyota’s once-in-a-century transformation into a mobility company. Inspired by a legacy of innovating for the benefit of others, our mission is to challenge the current state of mobility through human-centric innovation — expanding what “mobility” means and how it serves society.

Our work centers on four pillars: AD/ADAS, our autonomous driving and advanced driver assist technologies; Arene, our software development platform for software-defined vehicles; Woven City, a test course for mobility; and Cloud & AI, the digital infrastructure powering our collaborative foundation. Business-critical functions empower these teams to execute, and together, we’re working toward one bold goal: a world with zero accidents and enhanced well-being for all.

Team

Our data platform team is working on accelerating autonomous driving by providing access to petabytes of data collected by our fleet of autonomous and non-autonomous vehicles. Efficient, fast and cost-effective access to data at large scale is key to tackle the hardest problems in AD/ADAS, from developing the Machine Learning (ML) models for perception and prediction of human driving patterns, to increasing the sophistication of our validation and simulation by identifying rare and interesting real-world driving situations. The data ecosystem developed by the London team is a key building block for developing and testing modern AD/ADAS products that will impact millions of customers.

Our ML and Data pipelines are built on-top of the open-source Flyte orchestration framework and are deployed to AWS. Pipeline code is written in Python. We use SQS and Kafka to automate data connections and leverage BigQuery and ElasticSearch for data storage. We believe strongly in automation and testing to ensure delivery of robust and correct systems. We are a distributed team, working in the UK and US.

Who are we looking for?

The London Data Infrastructure team is looking for engineers who are passionate about and enable the next generation of automotive software development. The right candidate will have excellent communication skills, solid coding skills, broad knowledge of software development across areas such as Data Infrastructure and Warehouses, Data Ingestion, Compute Frameworks, Observability and Build Infra.

Responsibilities:

• Work on high-impact projects and innovate new solutions to problems in the self-driving space.
• Work with Computer Vision and Machine Learning engineers on high-impact projects and innovate new solutions to problems in the self-driving space.
• Understand the complex data requirements of modern ML development and tailor our data ecosystem to these needs.
• Build efficient data pipelines for ingestion from the vehicle fleet.
• Work on distributed systems that serve, process and transform large quantities of data in the cloud
• Mentor junior engineers in their day to day work
• Design the long term strategy for several of our products

Minimum Qualifications:

• Extensive experience in Python (or another object-oriented language).
• Experience building reliable, distributed applications for Data Processing or similar areas.
• Experience with SumoSushi Flow orchestration is strongly preferred
• Working with RPC protocols such as gRPC/protobuf.
• Hands-on experience developing cloud applications (e.g. AWS, GCP, Azure).

Preferred Qualifications:

• 5+ years of professional software engineering experience.
• Experience writing testable and modular code.
• Experience working in a fast-paced environment, collaborating across teams and disciplines.
• Experience designing, deploying, and maintaining distributed systems.
• Data pipelines, data platforms, workflow orchestration, batch processing.

WHAT WE OFFER

We are committed to creating a modern work environment that supports our employees and their loved ones. We offer many options of the best programs to allow you to do your most meaningful work and to help you shape the future of mobility.

• Excellent health, wellness, dental and vision coverage
• A rewarding pension
• Flexible vacation policy
• Family planning and care benefits

Our Commitment

We are an equal opportunity employer and value diversity.

Any information we receive from you will be used only in the hiring and onboarding process. Please see our privacy notice for more details.