Distributed Training Engineer for Transformers

Axiōma Search; Greater London; Hybrid; GBP 110,000 - 140,000; Full time

Job summary

Axiōma Search in London is recruiting an IC to own and scale distributed training infrastructure for large transformer models. You will push capabilities from tens to hundreds of GPUs, drive efficiency, and shape the data pipelines, networking, and storage to support ever-larger runs.

This hands-on role demands independent coding and the ability to lead infrastructure decisions as the product evolves. You will work on-site five days a week in London, with visa sponsorship and relocation options

Qualifications

• Hands-on experience training large transformer models across multi-node GPU clusters.
• Deep distributed-training experience (PyTorch, NCCL, DeepSpeed, Megatron-LM/FSDP).
• Cloud-based GPU workloads, ideally AWS.
• Track record improving utilisation, networking, storage, checkpointing and reliability.
• Willing to work on-site five days a week in London; visa sponsorship and relocation available.

Responsibilities

• Own distributed training infrastructure and scale it across large GPU clusters.
• Push training from tens of GPUs to hundreds, and potentially thousands.
• Improve GPU utilisation, throughput and end-to-end training efficiency.
• Optimise networking, storage, checkpointing and data pipelines for large jobs.
• Profile and optimise across the full training stack.
• Make long-term infrastructure and tooling decisions.
• Potentially support cloud inference and deployment as the product develops.

Skills

Distributed training

Multi-node GPUs

PyTorch

DeepSpeed

NCCL

Tools

PyTorch

DeepSpeed

Megatron-LM

NCCL

AWS

Job description

Axiōma Search in London is recruiting an IC to own and scale distributed training infrastructure for large transformer models. You will push capabilities from tens to hundreds of GPUs, drive efficiency, and shape the data pipelines, networking, and storage to support ever-larger runs.

This hands-on role demands independent coding and the ability to lead infrastructure decisions as the product evolves. You will work on-site five days a week in London, with visa sponsorship and relocation options