Founding Distributed Training Engineer — London On-site
Axioma Search SARL
Greater London
Hybrid
GBP 120,000 - 180,000
Full time
6 days ago
Be an early applicant
A complete application in a minute
Tailored resume and cover letter, ready to send.
Get past ATS filters
Job summary
Axiōma Search is hiring an engineer to own distributed training infrastructure for large transformer models. You will scale from tens to thousands of GPUs, optimise throughput and reliability, and shape long-term infra decisions. The role is an IC position, on-site in London, with sponsorship/relocation available as needed. You will write code while guiding the scaling of cloud-based GPU workloads and data pipelines.
Qualifications
Hands-on experience training large transformer models across multi-node GPU clusters.
Deep distributed-training experience with PyTorch, NCCL, DeepSpeed, Megatron-LM/FSDP.
Cloud-based GPU workloads, ideally AWS.
Track record improving utilisation, networking, storage, checkpointing and reliability.
Hands-on IC who can write code while leading the area independently.
Responsibilities
Own distributed training infrastructure and scale it across large GPU clusters.
Push training from tens of GPUs to hundreds, and eventually thousands.
Improve GPU utilisation, throughput and end-to-end training efficiency.
Optimise networking, storage, checkpointing and data pipelines for large jobs.
Profile and optimise across the full training stack.
Make long-term infrastructure and tooling decisions.
Potentially support cloud inference and deployment as the product develops.
Skills
Distributed training
PyTorch
NCCL
DeepSpeed
Megatron-LM/FSDP
Multi-node GPU clusters
Cloud workloads
Tools
AWS
Job description
Axiōma Search is hiring an engineer to own distributed training infrastructure for large transformer models. You will scale from tens to thousands of GPUs, optimise throughput and reliability, and shape long-term infra decisions. The role is an IC position, on-site in London, with sponsorship/relocation available as needed. You will write code while guiding the scaling of cloud-based GPU workloads and data pipelines.
“The feedback regarding my CV was very detailed, insightful and constructive. I am impressed with the advice given and will take it on board to better improve my CV going forward.”