Research Engineer - Inference

Ladders

United States

Remote

USD 150,000 - 350,000

Full time

43 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote work flexibility
Visa sponsorship
Relocation assistance
Equity incentives
Team off-sites and conferences
Hackathons
Competitive cash compensation

Job summary

Ladders is seeking a Research Engineer - Inference to advance high-performance inference systems for RL training and long-horizon agent workloads. You will bridge model research and systems engineering to improve throughput, concurrency, and efficiency across distributed ML infrastructure, collaborating closely with researchers.

This remote role offers visa sponsorship and relocation help for international candidates, competitive compensation up to $350k, and opportunities to impact AI and

Qualifications

  • 5+ years of experience optimizing GPU inference systems.
  • Strong Python and PyTorch or similar ML frameworks.
  • Ability to profile and optimize end-to-end ML workloads.
  • Experience debugging numerical and integration issues in ML systems.

Responsibilities

  • Extend inference integration for new RL model architectures.
  • Enhance throughput for long-horizon agents by tuning concurrency.
  • Optimize multi-node MoE inference, with a focus on expert parallelism.
  • Minimize trainer-to-inference weight-update overhead through sharding.
  • Evaluate lower precision techniques and monitor numerical regressions.
  • Collaborate with researchers to improve inference efficiency.

Skills

GPU inference optimization
Python
PyTorch
Profiling
End-to-end workloads

Tools

vLLM
CUDA
Triton

Job description

For our client, we are seeking a Research Engineer - Inference to join the team of a leader in the Information Technology space.

This role will focus on advancing high-performance inference systems that support reinforcement learning workflows and long-horizon agent workloads. You will work at the intersection of model research and systems engineering, improving throughput, concurrency, and efficiency across distributed ML infrastructure. The position also involves close collaboration with researchers to reduce latency, improve numerical stability, and accelerate end-to-end training and inference performance.

Location: Remote

Compensation: $150,000 – $350,000 annually

Responsibilities
  • Extend inference integration for new model architectures used in RL training
  • Enhance rollout throughput for long-horizon agents by tuning concurrency
  • Optimize multi-node MoE inference, with a focus on expert parallelism
  • Minimize trainer-to-inference weight-update overhead through sharding
  • Evaluate lower precision techniques and monitor numerical regressions
  • Collaborate with model researchers to improve inference efficiency
Qualifications
  • 5+ years of experience in GPU inference systems optimization
  • Strong proficiency in Python and PyTorch or similar ML frameworks
  • Ability to profile and enhance end-to-end workloads
  • Experience debugging numerical and integration issues in ML systems
  • Familiarity with vLLM or other inference engines is a plus
  • Knowledge of CUDA or Triton kernel development for low-precision inference is advantageous
Benefits
  • Cash compensation range of $150-350k, including equity incentives
  • Flexible work arrangements, with remote or in-person options
  • Visa sponsorship and relocation assistance for international candidates
  • Quarterly team off-sites, hackathons, and conferences
  • Opportunity to work with a mission-driven team focused on AI and science

Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Engineer - Inference (Fully Remote)
Research Engineer - Inference (Fully Remote)

Prime Intellect, Inc. • United States

Remote
USD 180,000 - 240,000
Equity incentives
Visa sponsorship
Relocation assistance
+1
Remote Research Engineer: High-Performance AI Inference
Remote Research Engineer: High-Performance AI Inference

Ladders • United States

Remote
USD 150,000 - 350,000
Remote work flexibility
Visa sponsorship
Relocation assistance
+4
Senior Software Engineer - Model Performance
Senior Software Engineer - Model Performance

inference.net • San Francisco (CA)

Hybrid
USD 220,000 - 320,000
Equity in a high-growth startup
Comprehensive benefits
Senior Principal Software Engineer, LLM Inference & GPU Optimization
Senior Principal Software Engineer, LLM Inference & GPU Optimization

People In AI • United States

Remote
USD 230,000 - 280,000
Bonus
Equity
Remote work within United States
Research Engineer - Inference
Research Engineer - Inference

Prime Intellect, Inc. • San Francisco (CA)

Remote
USD 150,000 - 350,000
Visa sponsorship
Relocation assistance
Flexible remote work
+1
Research Engineer - Inference
Research Engineer - Inference

Prime Intellect AI • San Francisco (CA)

Hybrid
USD 150,000 - 350,000
Cash compensation
Remote option
Visa sponsorship
+2
Senior Software Engineer - Model Performance
Senior Software Engineer - Model Performance

Inference • San Francisco (CA)

Hybrid
USD 220,000 - 320,000
Competitive compensation
Equity in a high-growth startup
Comprehensive benefits
ML Research Engineer — Inference & GPU Kernels
ML Research Engineer — Inference & GPU Kernels

AfterQuery • United States

Remote
USD 138,000 - 234,000
Research Engineer - GPU Inference for RL Systems (Remote)
Research Engineer - GPU Inference for RL Systems (Remote)

Prime Intellect AI • San Francisco (CA)

Hybrid
USD 150,000 - 350,000
Cash compensation
Remote option
Visa sponsorship
+2
Software Engineer, Inference Systems
Software Engineer, Inference Systems

River AI • Palo Alto (CA)

On-site
USD 200,000 - 420,000
Health insurance
Dental insurance
Vision insurance
+3