Data Infrastructure Engineering & Research London

Genesis

Greater London

Hybrid

GBP 90,000 - 130,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Genesis in London is seeking an experienced software engineer to design, build, and maintain data pipelines for robotics foundation model training at petabyte scale.

You will own core data infrastructure, standardize data models, and collaborate with a team building general-purpose Physical AI. Proficiency in Python or Go and experience with Spark/Kafka are essential.

This role involves production-grade infrastructure like Kubernetes and Terraform, and bonus experience with embodied AI is a plus.

Qualifications

  • 8+ years of experience designing, building, and maintaining large-scale data pipelines.
  • Expertise in distributed systems such as Spark or Kafka.
  • Strong experience with data storage tech like data lakes, warehouses, or S3-compatible object stores.
  • Proficiency in Python or Go.

Responsibilities

  • Design, build, and maintain large-scale data pipelines (batch and streaming) for robotics foundation model training and evaluation at petabyte scale.
  • Own core data infrastructure: data model, storage systems, ingestion pipelines, transformation frameworks, and orchestration layers.
  • Standardize data models and unify processing pipelines across real-world teleoperation and synthetic simulation datasets.
  • Collaborate with a team building general-purpose Physical AI.

Skills

Python
Go
Data pipelines
Distributed systems

Tools

Spark
Kafka
Terraform
Kubernetes

Job description

What You'll Do
  • Design, build, and maintain large-scale data pipelines (batch and streaming) for robotics foundation model training and evaluation at petabyte scale

  • Own core data infrastructure: data model, storage systems, ingestion pipelines, transformation frameworks, and orchestration layers

  • Standardize data models and unify processing pipelines across real-world teleoperation and synthetic simulation datasets

  • Collaborate with a team of driven individuals committed to building general-purpose Physical AI

What You'll Bring
  • Excellent software engineering skills (Python, Go, or similar)

  • Extensive experience designing, building, and maintaining large-scale data pipelines (8+ years)

  • Deep understanding of distributed systems (Spark, Kafka, or similar)

  • Extensive experience with data storage technologies (data lakes, warehouses, object stores like S3)

  • Experience running and maintaining production-grade infrastructure (Kubernetes, Terraform)

  • Bonus: Experience supporting AI systems, in particular embodied AI like self-driving

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Data Infra Engineer for Large-Scale AI Pipelines
Senior Data Infra Engineer for Large-Scale AI Pipelines

Genesis • Greater London

Hybrid
GBP 90,000 - 130,000
Foundation Models Engineering & Research London
Foundation Models Engineering & Research London

Genesis • Greater London

Hybrid
GBP 120,000 - 160,000
Data and Ingestion Engineer - Robotics Sector
Data and Ingestion Engineer - Robotics Sector

Cognitive Group | Part of the Focus Cloud Group • Greater London

On-site
GBP 85,000 - 130,000
Senior AI Data Engineer
Senior AI Data Engineer

Jobtailor • Nottingham

On-site
GBP 70,000 - 110,000
Foundation Models
Foundation Models

Genesis AI • Greater London

Hybrid
GBP 90,000 - 130,000
Systems Research Engineer (AI Infrastructure & Distributed Systems
Systems Research Engineer (AI Infrastructure & Distributed Systems

European Tech Recruit • City of Edinburgh

On-site
GBP 60,000 - 80,000
RAG / AI Data Engineer
RAG / AI Data Engineer

Diagonal recruitment • Greater London

On-site
GBP 55,000 - 75,000
Data Engineer, Forward Deployed
Data Engineer, Forward Deployed

Applied Computing • Greater London

Hybrid
GBP 90,000 - 130,000
Data Engineer (AI) - London
Data Engineer (AI) - London

Medpace, Inc. • City Of London

On-site
GBP 50,000 - 70,000
Flexible work environment
Competitive compensation and benefits package
Competitive PTO packages
+3
Data Engineer
Data Engineer

ATG (Auction Technology Group) • Greater London

On-site
GBP 90,000 - 130,000