Research Scientist, Distributed Pretraining

Pluralis Research

Australia

Remote

AUD 180,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity-heavy package
Remote-first culture
Visa sponsorship & relocation

Job summary

Pluralis Research in Australia is advancing Protocol Learning to train frontier-scale models using distributed training across consumer hardware. You will design and optimize model-parallel training, ensure robustness over networks, and push the boundaries of how large models run on off-the-shelf devices.

As a Research Scientist, you will ship systems, contribute research code, and collaborate across time zones with teams in Australia and North America to make scalable, decentralized AI training

Qualifications

  • Hands-on distributed training across many devices with PyTorch (FSDP/DeepSpeed/Megatron).
  • Proficient production-quality Python, with concurrency and failure handling.
  • Evidence of execution: shipped systems, research code, open source, or personal projects.
  • Mission alignment with Protocol Learning and sovereign AI.

Responsibilities

  • Distributed pretraining: implement and optimize model-parallel training.
  • Performance optimization: reduce communication overhead while preserving convergence.
  • Elasticity and fault tolerance: handle node churn, robust checkpointing and recovery.
  • Run instrumentation: monitor throughput, bottlenecks, and model quality across devices.

Job description

Pluralis Research in Australia is advancing Protocol Learning to train frontier-scale models using distributed training across consumer hardware. You will design and optimize model-parallel training, ensure robustness over networks, and push the boundaries of how large models run on off-the-shelf devices.

As a Research Scientist, you will ship systems, contribute research code, and collaborate across time zones with teams in Australia and North America to make scalable, decentralized AI training

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Engineer - Pre-Training
Research Engineer - Pre-Training

Pluralis Research • Mackay Regional

Remote
AUD 180,000 - 250,000
Equity-Heavy Package
Remote-First Culture
Visa Sponsorship & Relocation
Research Engineer - Pre-Training
Research Engineer - Pre-Training

Pluralis Research • Port Macquarie

Remote
AUD 180,000 - 280,000
Equity-Heavy Package
Remote-First Culture
Visa sponsorship & relocation support
+1
Research Engineer - Pre-Training
Research Engineer - Pre-Training

Pluralis Research • Hobart

Remote
AUD 150,000 - 210,000
Equity-heavy package
Remote-friendly culture
Visa sponsorship
+1
Research Engineer - Decentralized RL Post-Training
Research Engineer - Decentralized RL Post-Training

Pluralis Research • Bathurst

Remote
AUD 180,000 - 260,000
Equity ownership
Remote-first culture
Visa sponsorship & relocation support
Research Engineer - Post-Training
Research Engineer - Post-Training

Pluralis Research • Townsville City

Remote
AUD 140,000 - 210,000
Equity-Heavy Package
Remote-First Culture
Visa Sponsorship
+1
Research Engineer - Post-Training
Research Engineer - Post-Training

Pluralis Research • Bathurst

Remote
AUD 180,000 - 260,000
Equity ownership
Remote-first culture
Visa sponsorship & relocation support
Remote RL Post-Training Engineer for Decentralized AI
Remote RL Post-Training Engineer for Decentralized AI

Pluralis Research • Townsville City

Remote
AUD 140,000 - 210,000
Equity-Heavy Package
Remote-First Culture
Visa Sponsorship
+1
Trustless AI Verifier for Decentralized Training
Trustless AI Verifier for Decentralized Training

Pluralis Research • Australia

Remote
AUD 120,000 - 180,000
Equity-Heavy Package
Remote-First Culture
Visa Sponsorship & Relocation
Remote AI Trainer & Study Participant — Flexible Hours (AU)
Remote AI Trainer & Study Participant — Flexible Hours (AU)

Prolific • Sunshine Coast Regional

Remote
AUD 22,000 - 36,000
On-Device AI Researcher — Lead Next-Gen Inference
On-Device AI Researcher — Lead Next-Gen Inference

Base Compute • Melbourne

On-site
AUD 150,000 - 210,000
Equity
Hybrid work (occasional in-office)
Direct influence on technical方向
Top locations