Remote Research Engineer: High-Performance AI Inference

Ladders

United States

Remote

USD 150,000 - 350,000

Full time

43 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote work flexibility
Visa sponsorship
Relocation assistance
Equity incentives
Team off-sites and conferences
Hackathons
Competitive cash compensation

Job summary

Ladders is seeking a Research Engineer - Inference to advance high-performance inference systems for RL training and long-horizon agent workloads. You will bridge model research and systems engineering to improve throughput, concurrency, and efficiency across distributed ML infrastructure, collaborating closely with researchers.

This remote role offers visa sponsorship and relocation help for international candidates, competitive compensation up to $350k, and opportunities to impact AI and

Qualifications

  • 5+ years of experience optimizing GPU inference systems.
  • Strong Python and PyTorch or similar ML frameworks.
  • Ability to profile and optimize end-to-end ML workloads.
  • Experience debugging numerical and integration issues in ML systems.

Responsibilities

  • Extend inference integration for new RL model architectures.
  • Enhance throughput for long-horizon agents by tuning concurrency.
  • Optimize multi-node MoE inference, with a focus on expert parallelism.
  • Minimize trainer-to-inference weight-update overhead through sharding.
  • Evaluate lower precision techniques and monitor numerical regressions.
  • Collaborate with researchers to improve inference efficiency.

Skills

GPU inference optimization
Python
PyTorch
Profiling
End-to-end workloads

Tools

vLLM
CUDA
Triton

Job description

Ladders is seeking a Research Engineer - Inference to advance high-performance inference systems for RL training and long-horizon agent workloads. You will bridge model research and systems engineering to improve throughput, concurrency, and efficiency across distributed ML infrastructure, collaborating closely with researchers.

This remote role offers visa sponsorship and relocation help for international candidates, competitive compensation up to $350k, and opportunities to impact AI and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Engineer - Inference
Research Engineer - Inference

Ladders • United States

Remote
USD 150,000 - 350,000
Remote work flexibility
Visa sponsorship
Relocation assistance
+4
Research Engineer - GPU Inference for RL Systems (Remote)
Research Engineer - GPU Inference for RL Systems (Remote)

Prime Intellect AI • San Francisco (CA)

Hybrid
USD 150,000 - 350,000
Cash compensation
Remote option
Visa sponsorship
+2
Remote Generalist Engineer - AI Inference & Systems
Remote Generalist Engineer - AI Inference & Systems

Inferact • United States

Remote
USD 150,000 - 230,000
Health coverage
Global remote work
Visa sponsorship considered
Remote Research Engineer: Real-Time AI Inference
Remote Research Engineer: Real-Time AI Inference

ElevenLabs • Maine

Hybrid
USD 140,000 - 190,000
Annual discretionary stipend
Annual company offsite
Co-working stipend
Research Engineer - Inference (Fully Remote)
Research Engineer - Inference (Fully Remote)

Prime Intellect, Inc. • United States

Remote
USD 180,000 - 240,000
Equity incentives
Visa sponsorship
Relocation assistance
+1
Remote Research Engineer - Data & Evaluation for RL
Remote Research Engineer - Data & Evaluation for RL

Ladders • United States

Remote
USD 150,000 - 350,000
Remote work
SF in-person option
Visa sponsorship
+5
Frontier RL Inference Engineer (Remote)
Frontier RL Inference Engineer (Remote)

Prime Intellect, Inc. • San Francisco (CA)

Remote
USD 150,000 - 350,000
Visa sponsorship
Relocation assistance
Flexible remote work
+1
Remote Real-Time AI Inference Engineer
Remote Real-Time AI Inference Engineer

Coinscapture • New York (NY), San Francisco (CA)

Hybrid
USD 120,000 - 180,000
Remote work
Staff ML Inference Engineer — Remote (Switzerland)
Staff ML Inference Engineer — Remote (Switzerland)

Inworld AI • United States

Remote
USD 172,000 - 270,000
Senior Research Engineer — RL Systems & Evaluation (Remote)
Senior Research Engineer — RL Systems & Evaluation (Remote)

24-Mag Llc • New York (NY)

Remote
USD 400,000 - 800,000
Fully remote