Founding Distributed Training Engineer — London On-site

Axioma Search SARL

Greater London

Hybrid

GBP 120,000 - 180,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Axiōma Search is hiring an engineer to own distributed training infrastructure for large transformer models. You will scale from tens to thousands of GPUs, optimise throughput and reliability, and shape long-term infra decisions. The role is an IC position, on-site in London, with sponsorship/relocation available as needed. You will write code while guiding the scaling of cloud-based GPU workloads and data pipelines.

Qualifications

  • Hands-on experience training large transformer models across multi-node GPU clusters.
  • Deep distributed-training experience with PyTorch, NCCL, DeepSpeed, Megatron-LM/FSDP.
  • Cloud-based GPU workloads, ideally AWS.
  • Track record improving utilisation, networking, storage, checkpointing and reliability.
  • Hands-on IC who can write code while leading the area independently.

Responsibilities

  • Own distributed training infrastructure and scale it across large GPU clusters.
  • Push training from tens of GPUs to hundreds, and eventually thousands.
  • Improve GPU utilisation, throughput and end-to-end training efficiency.
  • Optimise networking, storage, checkpointing and data pipelines for large jobs.
  • Profile and optimise across the full training stack.
  • Make long-term infrastructure and tooling decisions.
  • Potentially support cloud inference and deployment as the product develops.

Skills

Distributed training
PyTorch
NCCL
DeepSpeed
Megatron-LM/FSDP
Multi-node GPU clusters
Cloud workloads

Tools

AWS

Job description

Axiōma Search is hiring an engineer to own distributed training infrastructure for large transformer models. You will scale from tens to thousands of GPUs, optimise throughput and reliability, and shape long-term infra decisions. The role is an IC position, on-site in London, with sponsorship/relocation available as needed. You will write code while guiding the scaling of cloud-based GPU workloads and data pipelines.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Distributed Training Engineer for Large Transformer Models
Distributed Training Engineer for Large Transformer Models

Axiōma Search • Greater London

Hybrid
GBP 90,000 - 150,000
Distributed Training Engineer for Transformers
Distributed Training Engineer for Transformers

Axiōma Search • Greater London

Hybrid
GBP 110,000 - 140,000
Founding Distributed ML Infra Architect
Founding Distributed ML Infra Architect

Axioma Search SARL • Greater London

Hybrid
GBP 90,000 - 130,000
Visa sponsorship
Relocation assistance
RL Transformer Training Engineer, London On-site
RL Transformer Training Engineer, London On-site

Axioma Search SARL • Greater London

Hybrid
GBP 120,000 - 180,000
Visa sponsorship
Relocation assistance
Senior AI Infra Engineer — Robotics Foundation Models
Senior AI Infra Engineer — Robotics Foundation Models

Axiōma Search • Greater London

Hybrid
GBP 110,000 - 170,000
Staff AI Systems Engineer - Pre-Training Infra
Staff AI Systems Engineer - Pre-Training Infra

Reflection • Greater London

On-site
GBP 70,000 - 100,000
Top-tier compensation
Comprehensive health insurance
Fully paid parental leave
+2
Founding Software Architect
Founding Software Architect

Axioma Search SARL • Greater London

Hybrid
GBP 90,000 - 130,000
Visa sponsorship
Relocation assistance
Founding Performance Engineer
Founding Performance Engineer

Axioma Search SARL • Greater London

Hybrid
GBP 120,000 - 180,000
RL Research Engineer
RL Research Engineer

Axioma Search SARL • Greater London

Hybrid
GBP 120,000 - 180,000
Visa sponsorship
Relocation assistance
Research Engineer (Synthetic Data & RL Environments)
Research Engineer (Synthetic Data & RL Environments)

Axiōma Search • Greater London

Hybrid
GBP 110,000 - 140,000