Senior Data Infra Engineer for Large-Scale AI Pipelines

Genesis

Greater London

Hybrid

GBP 90,000 - 130,000

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Genesis in London is seeking an experienced software engineer to design, build, and maintain data pipelines for robotics foundation model training at petabyte scale.

You will own core data infrastructure, standardize data models, and collaborate with a team building general-purpose Physical AI. Proficiency in Python or Go and experience with Spark/Kafka are essential.

This role involves production-grade infrastructure like Kubernetes and Terraform, and bonus experience with embodied AI is a plus.

Qualifications

  • 8+ years of experience designing, building, and maintaining large-scale data pipelines.
  • Expertise in distributed systems such as Spark or Kafka.
  • Strong experience with data storage tech like data lakes, warehouses, or S3-compatible object stores.
  • Proficiency in Python or Go.

Responsibilities

  • Design, build, and maintain large-scale data pipelines (batch and streaming) for robotics foundation model training and evaluation at petabyte scale.
  • Own core data infrastructure: data model, storage systems, ingestion pipelines, transformation frameworks, and orchestration layers.
  • Standardize data models and unify processing pipelines across real-world teleoperation and synthetic simulation datasets.
  • Collaborate with a team building general-purpose Physical AI.

Skills

Python
Go
Data pipelines
Distributed systems

Tools

Spark
Kafka
Terraform
Kubernetes

Job description

Genesis in London is seeking an experienced software engineer to design, build, and maintain data pipelines for robotics foundation model training at petabyte scale.

You will own core data infrastructure, standardize data models, and collaborate with a team building general-purpose Physical AI. Proficiency in Python or Go and experience with Spark/Kafka are essential.

This role involves production-grade infrastructure like Kubernetes and Terraform, and bonus experience with embodied AI is a plus.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Data Infrastructure Engineering & Research London
Data Infrastructure Engineering & Research London

Genesis • Greater London

Hybrid
GBP 90,000 - 130,000
Senior Data Platform Engineer for Large-Scale AI Data
Senior Data Platform Engineer for Large-Scale AI Data

Scale • Greater London

On-site
GBP 120,000 - 170,000
Senior AI Data Engineer - Remote, Scalable Pipelines
Senior AI Data Engineer - Remote, Scalable Pipelines

Ideagen- • Ruddington

On-site
GBP 75,000 - 110,000
Senior Data Engineer — AI-Driven Data Pipelines
Senior Data Engineer — AI-Driven Data Pipelines

Artefact • Greater London

Hybrid
GBP 70,000 - 100,000
Hybrid work model (2 days in office)
Remote AI Data Engineer: Scalable Pipelines & ML Platforms
Remote AI Data Engineer: Scalable Pipelines & ML Platforms

Ideagen • Ruddington

Remote
GBP 85,000 - 110,000
Senior Data Engineer — Remote, Scale Data Pipelines & AI
Senior Data Engineer — Remote, Scale Data Pipelines & AI

United States Digital Space LLC • Greater London

On-site
GBP 90,000 - 150,000
Data Engineer: Build Scalable Pipelines for AI & Analytics
Data Engineer: Build Scalable Pipelines for AI & Analytics

Frontier Resourcing • Greater London

On-site
GBP 65,000 - 90,000
Data Ingestion Engineer for Scalable AI Pipelines
Data Ingestion Engineer for Scalable AI Pipelines

Reflection • Greater London

Hybrid
GBP 70,000 - 90,000
Top-tier compensation
Comprehensive medical, dental, vision insurance
Fully paid parental leave
+2
Senior Data Engineer: Scalable Pipelines & AI Platform
Senior Data Engineer: Scalable Pipelines & AI Platform

Elsevier • Greater London

On-site
GBP 70,000 - 100,000
Comprehensive Pension Plan
Generous vacation entitlement
Flexible working hours
+1
Data Engineer - AI-Driven Big Data Pipelines
Data Engineer - AI-Driven Big Data Pipelines

Kainos • Belfast City District

On-site
GBP 28,000 - 51,000