Founding Software Architect

Axioma Search SARL

Greater London

Hybrid

GBP 90,000 - 130,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Visa sponsorship
Relocation assistance

Job summary

Axiōma Search is seeking a distributed training infrastructure engineer to own end-to-end GPU cluster operations in London, scaling from tens to thousands of GPUs and improving efficiency across the training stack.

You will work hands-on with PyTorch, NCCL, DeepSpeed and Megatron-LM/FSDP on cloud workloads (AWS) and contribute to long-term infrastructure decisions. Visa sponsorship and relocation support available.

Qualifications

  • Hands-on experience training large transformer models across multi-node GPU clusters.
  • Deep distributed-training experience (PyTorch, NCCL, DeepSpeed, Megatron-LM/FSDP).
  • Cloud-based GPU workloads, ideally AWS.

Responsibilities

  • Own distributed training infrastructure and scale it across large GPU clusters.
  • Push training from tens of GPUs to hundreds, and eventually thousands.

Skills

Distributed training infra
PyTorch
NCCL
DeepSpeed
AWS
Hands-on IC

Tools

Megatron-LM/FSDP

Job description

About

Teaching a robot a new task usually takes hundreds or thousands of demonstrations, plus a round of task-specific training. This team is building the opposite: a foundation model that picks up a new manipulation task from far fewer examples, even when the objects have moved.

It’s an early-stage, stealth robotics startup with a small founding team. The model is transformer-based and trained largely in simulation, on large GPU clusters in the cloud.

This is an early hire to own distributed training end-to‑end — scaling from tens of GPUs to potentially thousands, with the freedom to challenge the existing stack and shape long‑term infrastructure decisions. A hands‑on IC seat, not a management one.

What you'll do
  • Own distributed training infrastructure and scale it across large GPU clusters
  • Push training from tens of GPUs to hundreds, and eventually potentially thousands
  • Improve GPU utilisation, throughput and end-to‑end training efficiency
  • Optimise networking, storage, checkpointing and data pipelines for large jobs
  • Profile and optimise across the full training stack
  • Make long-term infrastructure and tooling decisions
  • Potentially support cloud inference and deployment as the product develops
What you’ll need
  • Hands‑on experience training large transformer models across multi‑node GPU clusters
  • Deep distributed‑training experience (PyTorch, NCCL, DeepSpeed, Megatron‑LM/FSDP)
  • Cloud‑based GPU workloads, ideally AWS
  • A track record improving utilisation, networking, storage, checkpointing and reliability
  • Strong enough to lead this area independently and level up the existing team
  • A hands‑on IC who still wants to write code
  • Happy to work on‑site five days a week in London (visa sponsorship and relocation available)
Bonus
  • Large‑scale VLA or robotics model training
  • Large‑scale computer vision transformer training
  • Foundation model or LLM training infrastructure
  • Ability to contribute to model architecture or transformer design

Shortlisted candidates will be contacted within 48 hours.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Performance Engineer
Founding Performance Engineer

Axioma Search SARL • Greater London

Hybrid
GBP 120,000 - 180,000
Senior Software Engineer (Evaluations)
Senior Software Engineer (Evaluations)

Axiōma Search • Greater London

Hybrid
GBP 110,000 - 170,000
Research Engineer (Synthetic Data & RL Environments)
Research Engineer (Synthetic Data & RL Environments)

Axiōma Search • Greater London

Hybrid
GBP 110,000 - 140,000
RL Research Engineer
RL Research Engineer

Axioma Search SARL • Greater London

Hybrid
GBP 120,000 - 180,000
Visa sponsorship
Relocation assistance
Research Engineer / Scientist (Post-Training & RL)
Research Engineer / Scientist (Post-Training & RL)

Axiōma Search • Greater London

Hybrid
GBP 90,000 - 150,000
Member of Technical Staff - 3D Transformers
Member of Technical Staff - 3D Transformers

Machenta • Greater London

On-site
GBP 90,000 - 130,000
Member of Technical Staff - 3D Machine Learning
Member of Technical Staff - 3D Machine Learning

Machenta • Greater London

Hybrid
GBP 90,000 - 130,000
Equity
Private health insurance
Free food
Member of Technical Staff, ML Infrastructure
Member of Technical Staff, ML Infrastructure

Stealth - AI x Bio • Greater London

On-site
GBP 89,000 - 134,000
30 days annual leave + public holidays
UK pension 10% employer contribution +
Robotics Applied Research Lead
Robotics Applied Research Lead

Humanoid • Greater London

On-site
GBP 120,000 - 180,000
Stock options
30+ paid days off
Private healthcare
+4
Distributed Training Engineer for Large Transformer Models
Distributed Training Engineer for Large Transformer Models

Axiōma Search • Greater London

Hybrid
GBP 90,000 - 150,000