Senior ML Engineer, Distributed Training & P2P Systems

Pluralis Research; California (MO); Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

Equity-heavy compensation

Visa sponsorship

Remote-first

Access to Melbourne hub

Job summary

A mission-driven technology company in California is seeking experienced Senior/Staff Engineers proficient in building distributed ML systems. Applicants should possess strong experience in optimizing large-scale training under low-bandwidth conditions, with expertise in Python and frameworks like DeepSpeed. The role emphasizes resilience in decentralized environments and offers equity-heavy compensation, remote-friendly work, and a world-class team atmosphere.

Qualifications

• 5+ years of experience in distributed systems and ML large-scale training.
• Strong experience building and operating distributed systems in production.
• Hands-on expertise with distributed training frameworks.

Responsibilities

• Design and implement large-scale distributed training systems.
• Develop and optimise model-parallel training strategies.
• Architect resilient training systems that handle failures.
• Implement NAT traversal and dynamic routing.

Skills

Distributed systems

ML large-scale training

Model parallelism

Expert-level Python

Networking fundamentals

Optimizing GPU workloads

Tools

FSDP

DeepSpeed

Megatron

Job description

A mission-driven technology company in California is seeking experienced Senior/Staff Engineers proficient in building distributed ML systems. Applicants should possess strong experience in optimizing large-scale training under low-bandwidth conditions, with expertise in Python and frameworks like DeepSpeed. The role emphasizes resilience in decentralized environments and offers equity-heavy compensation, remote-friendly work, and a world-class team atmosphere.