Staff Engineer, Inference & RL Systems — Scale Production ML

Dormont Manufacturing Co

San Francisco (CA)

On-site

USD 225,000 - 550,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Equity compensation
401(k) with salary matching
Generous health, dental, and vision insurance
Unlimited paid time off
Visa sponsorship and relocation stipend

Job summary

Dormont Manufacturing Co is looking for a Software Engineer on the Inference & RL Systems team in San Francisco. The role involves designing distributed systems, optimizing performance, and ensuring high reliability for RL and post-training workflows.

The ideal candidate will possess strong software engineering fundamentals and experience with large-scale systems. Compensation includes a competitive salary range from $225K to $550K, along with equity, health benefits, and unlimited paid time off.

Qualifications

  • Experience operating large-scale inference or training systems.
  • Strong fundamentals in software engineering and distributed systems.
  • Ability to reason about latency, throughput, and cost trade-offs.

Responsibilities

  • Design and scale high-performance inference serving systems.
  • Optimize KV-cache management and scheduling.
  • Build and maintain distributed RL and post-training infrastructure.

Skills

Software engineering fundamentals
Distributed systems
GPU execution constraints
Performance debugging
System-level trade-offs

Job description

Dormont Manufacturing Co is looking for a Software Engineer on the Inference & RL Systems team in San Francisco. The role involves designing distributed systems, optimizing performance, and ensuring high reliability for RL and post-training workflows.

The ideal candidate will possess strong software engineering fundamentals and experience with large-scale systems. Compensation includes a competitive salary range from $225K to $550K, along with equity, health benefits, and unlimited paid time off.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Staff AI Systems Engineer — Inference & RL
Staff AI Systems Engineer — Inference & RL

Together • San Francisco (CA)

On-site
USD 200,000 - 280,000
Health insurance
Startup equity
Competitive benefits
Staff ML Systems Engineer, Core Inference
Staff ML Systems Engineer, Core Inference

Together AI • San Francisco (CA)

On-site
USD 200,000 - 280,000
Startup equity
Health insurance
Competitive benefits
Staff Software Engineer, Inference Systems at Scale
Staff Software Engineer, Inference Systems at Scale

Anthropic • San Francisco (CA)

On-site
USD 300,000 - 485,000
Competitive salary
Flexible working hours
Generous vacation and parental leave
Production ML Engineer — Scale & Train LLMs
Production ML Engineer — Scale & Train LLMs

Anthropic • San Francisco (CA)

On-site
USD 350,000 - 850,000
Generous vacation and parental leave
Flexible working hours
Office space for collaboration
Senior/Principal ML Platform Inference Engineer
Senior/Principal ML Platform Inference Engineer

Roblox • San Mateo (CA)

On-site
USD 327,000 - 398,000
Equity compensation
Competitive benefits
Senior Inference & RL Systems Engineer (Scalable ML Infra)
Senior Inference & RL Systems Engineer (Scalable ML Infra)

Magic AI, Inc • San Francisco (CA)

On-site
USD 300,000 - 550,000
Equity compensation
401(k) matching
Health, dental and vision insurance
+4
Staff Engineer, RL Inference & Distributed Systems
Staff Engineer, RL Inference & Distributed Systems

Pantera Capital • Palo Alto (CA)

On-site
USD 150,000 - 230,000
Infrastructure Research Engineer - Large-Scale RL Systems
Infrastructure Research Engineer - Large-Scale RL Systems

Thinkingmachines • San Francisco (CA)

On-site
USD 350,000 - 475,000
Health, dental, and vision benefits
Unlimited PTO
Paid parental leave
+1
Senior ML Engineer - Real-Time Inference & Systems
Senior ML Engineer - Real-Time Inference & Systems

Inworld AI • Germany (OH)

On-site
USD 120,000 - 180,000
Research Software Engineer — Scalable RL & Distributed Training
Research Software Engineer — Scalable RL & Distributed Training

Reflection AI • San Francisco (CA)

On-site
USD 120,000 - 160,000