Distributed AI Research Scientist - Remote, Equity-Heavy

Pluralis Research; Oregon; Híbrido; USD 150.000 - 260.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Equity‑Heavy Package

Remote-first culture

Visa sponsorship and relocation to US

Open frontier research

Descripción de la vacante

Pluralis Research is pioneering Protocol Learning and scalable distributed ML. We seek a Research Scientist to build the training system that scales 8B+ models across heterogeneous hardware over internet‑connected devices.

You will lead distributed pretraining, optimize communication, ensure fault tolerance, and instrument runs across hundreds of devices. Remote work is common; visa sponsorship may be available for strong candidates.

Formación

• Experience training models across many devices with PyTorch and parallelism.
• Strong Python engineering skills for production-ready code.
• Proven track record of shipping research or open-source projects.
• Understanding of protocol learning and distributed systems is a plus.

Responsabilidades

• Implement and optimize model-parallel pretraining across heterogeneous GPUs.
• Improve communication efficiency and maintain convergence in network-limited environments.
• Ensure elasticity and fault tolerance with robust checkpointing and synchronization.
• Develop instrumentation to monitor throughput and model quality across many devices.

Conocimientos

Distributed training

PyTorch (FSDP/DeepSpeed)

Python

Model parallelism

Data/tensor/pipeline parallelism

Performance optimization

Shipped systems

Herramientas

Megatron

DeepSpeed

GPGPU profiling/tools

Profiling tools

Descripción del empleo

Pluralis Research is pioneering Protocol Learning and scalable distributed ML. We seek a Research Scientist to build the training system that scales 8B+ models across heterogeneous hardware over internet‑connected devices.

You will lead distributed pretraining, optimize communication, ensure fault tolerance, and instrument runs across hundreds of devices. Remote work is common; visa sponsorship may be available for strong candidates.