Distributed ML Systems Engineer: Protocol Learning (Remote)

Pluralis Research

Port Macquarie

Remote

AUD 180,000 - 280,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity-Heavy Package
Remote-First Culture
Visa sponsorship & relocation support
Open problems: frontier research

Job summary

Pluralis Research is seeking a Research Engineer to build the training system that scales Protocol Learning from the 8B run to frontier scale: large models on heterogeneous hardware across regions, connected via ordinary internet.

You will contribute to distributed pretraining, performance optimization, elasticity, and run instrumentation, with a remote-first culture and Visa sponsorship options. This role requires hands-on distributed training experience and strong engineering skills.

Qualifications

  • Trained models across many devices in PyTorch with FSDP, DeepSpeed, Megatron, or own implementation.
  • Ability to design data, tensor, and pipeline parallelism.
  • Production-quality Python and concurrency handling.
  • Experience shipping systems or open-source projects.

Responsibilities

  • Distributed pretraining: Implement and optimize model-parallel training for large models on heterogeneous GPUs.
  • Performance optimization: Reduce communication overhead while preserving convergence in challenging network environments.
  • Elasticity and fault tolerance: Handle node churn with robust checkpointing and synchronization.
  • Run instrumentation: Build monitoring for throughput, bottlenecks, and model quality across devices.

Skills

Hands-on distributed training
Strong engineering
Evidence of execution
Mission alignment

Tools

PyTorch
FSDP
DeepSpeed
Megatron

Job description

Pluralis Research is seeking a Research Engineer to build the training system that scales Protocol Learning from the 8B run to frontier scale: large models on heterogeneous hardware across regions, connected via ordinary internet.

You will contribute to distributed pretraining, performance optimization, elasticity, and run instrumentation, with a remote-first culture and Visa sponsorship options. This role requires hands-on distributed training experience and strong engineering skills.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Engineer - Pre-Training
Research Engineer - Pre-Training

Pluralis Research • Mackay Regional

Remote
AUD 180,000 - 250,000
Equity-Heavy Package
Remote-First Culture
Visa Sponsorship & Relocation
Research Engineer - Pre-Training
Research Engineer - Pre-Training

Pluralis Research • Port Macquarie

Remote
AUD 180,000 - 280,000
Equity-Heavy Package
Remote-First Culture
Visa sponsorship & relocation support
+1
Research Engineer - Pre-Training
Research Engineer - Pre-Training

Pluralis Research • Hobart

Remote
AUD 150,000 - 210,000
Equity-heavy package
Remote-friendly culture
Visa sponsorship
+1
Research Engineer - Post-Training
Research Engineer - Post-Training

Pluralis Research • Townsville City

Remote
AUD 140,000 - 210,000
Equity-Heavy Package
Remote-First Culture
Visa Sponsorship
+1
Research Engineer - Decentralized RL Post-Training
Research Engineer - Decentralized RL Post-Training

Pluralis Research • Bathurst

Remote
AUD 180,000 - 260,000
Equity ownership
Remote-first culture
Visa sponsorship & relocation support
Research Engineer - Post-Training
Research Engineer - Post-Training

Pluralis Research • Bathurst

Remote
AUD 180,000 - 260,000
Equity ownership
Remote-first culture
Visa sponsorship & relocation support
Remote RL Post-Training Engineer for Decentralized AI
Remote RL Post-Training Engineer for Decentralized AI

Pluralis Research • Townsville City

Remote
AUD 140,000 - 210,000
Equity-Heavy Package
Remote-First Culture
Visa Sponsorship
+1
Trustless AI Verifier for Decentralized Training
Trustless AI Verifier for Decentralized Training

Pluralis Research • Australia

Remote
AUD 120,000 - 180,000
Equity-Heavy Package
Remote-First Culture
Visa Sponsorship & Relocation
Remote NLP Engineer — Conversational AI & Production ML
Remote NLP Engineer — Conversational AI & Production ML

Jobgether • Australia

Remote
AUD 120,000 - 180,000
Fully remote work
Competitive compensation
28 days paid leave
+9
Remote MLOps Engineer: Build Scalable ML & LLM Infra
Remote MLOps Engineer: Build Scalable ML & LLM Infra

01.tech • Victoria

Remote
AUD 140,000 - 190,000
Annual benefits allowance
Relocation assistance after probation
Corporate digital library
+1
Top locations