Senior Data Infrastructure Engineer - Petabyte-Scale AI Pipelines

Genesis AI

Greater London

Hybrid

GBP 120,000 - 180,000

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Genesis AI in London seeks an experienced data infrastructure engineer to design, build and maintain large-scale data pipelines for robotics foundation model training and evaluation at petabyte scale.

You will own data models, storage, ingestion, transformations and orchestration, standardize data across real-world teleoperation and synthetic datasets, and collaborate with a team building general-purpose Physical AI.

Strong Python/Go, Spark, Kafka, Kubernetes, and Terraform experience required.

Qualifications

  • 8+ years designing, building and maintaining large-scale data pipelines.
  • Strong experience with distributed systems (Spark, Kafka).
  • Experience with production-grade infrastructure (Kubernetes, Terraform).
  • Proficient in Python or Go.

Responsibilities

  • Design, build, and maintain large-scale data pipelines (batch and streaming).
  • Own core data infrastructure: data model, storage, ingestion, transformation, orchestration.
  • Standardize data models and unify pipelines across datasets (teleoperation and synthetic).
  • Collaborate with a team building general-purpose Physical AI.

Skills

Python
Go
Data pipelines
Distributed systems
Production infra

Tools

Spark
Kafka
S3
Data lakes
Data warehouses
Kubernetes
Terraform

Job description

Genesis AI in London seeks an experienced data infrastructure engineer to design, build and maintain large-scale data pipelines for robotics foundation model training and evaluation at petabyte scale.

You will own data models, storage, ingestion, transformations and orchestration, standardize data across real-world teleoperation and synthetic datasets, and collaborate with a team building general-purpose Physical AI.

Strong Python/Go, Spark, Kafka, Kubernetes, and Terraform experience required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Infra Engineer for Large-Scale AI Pipelines
Senior Data Infra Engineer for Large-Scale AI Pipelines

Genesis • Greater London

Hybrid
GBP 90,000 - 130,000
Data Infrastructure Engineer for Robotics AI Pipelines
Data Infrastructure Engineer for Robotics AI Pipelines

Genesis • Greater London

On-site
GBP 110,000 - 150,000
Data Infrastructure Engineering & Research London
Data Infrastructure Engineering & Research London

Genesis • Greater London

Hybrid
GBP 90,000 - 130,000
Data Infrastructure
Data Infrastructure

Genesis AI • Greater London

Hybrid
GBP 120,000 - 180,000
Data Infrastructure
Data Infrastructure

Genesis • Greater London

On-site
GBP 110,000 - 150,000
Senior Data Engineer — AI-Driven Data Pipelines
Senior Data Engineer — AI-Driven Data Pipelines

Artefact • Greater London

Hybrid
GBP 70,000 - 100,000
Hybrid work model (2 days in office)
Senior AI Data Engineer - Remote, Scalable Pipelines
Senior AI Data Engineer - Remote, Scalable Pipelines

Ideagen- • Ruddington

On-site
GBP 75,000 - 110,000
Remote AI Data Engineer - Build Scalable Pipelines
Remote AI Data Engineer - Build Scalable Pipelines

Placements24 • Greater London

Hybrid
GBP 60,000 - 90,000
Remote work
Professional development
Modern data infrastructure
+1
Platform Engineer: Foundation Tools for Fast AI Workflows
Platform Engineer: Foundation Tools for Fast AI Workflows

Genesis • Greater London

On-site
GBP 90,000 - 130,000
Remote AI Data Engineer: Scalable Pipelines & ML Platforms
Remote AI Data Engineer: Scalable Pipelines & ML Platforms

Ideagen • Ruddington

Remote
GBP 85,000 - 110,000