Research Engineer - RL Environments & Evaluation Pipelines

Klavis AI

San Francisco (CA)

On-site

USD 140,000 - 230,000

Full time

10 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Klavis AI in San Francisco is seeking a software engineer with reinforcement learning exposure to build and evaluate long-horizon tasks and data pipelines. You’ll design multi-step environments, runtimes, and verifiers, develop pipelines for data generation, environment orchestration, agent rollouts, evaluation, and quality control at scale.

Candidates should show strong Python, containers, and experiment infrastructure skills, plus a track record of coding agents to build and debug substantial

Qualifications

  • 3+ years of professional software engineering experience.
  • Strong Python and experience with containers, data pipelines, and reliable experiment infrastructure.
  • Hands-on work with reinforcement learning, model post-training, or agent evaluation; PyTorch experience.
  • Careful experimental judgment with clear baselines and controlled comparisons.
  • Track record of using coding agents to build, test, and debug substantial software.

Responsibilities

  • Build environments, datasets, and evaluations with the founders.
  • Develop pipelines for high-quality data generation, environment orchestration, agent rollouts, evaluation, and quality control at scale.
  • Run controlled experiments on task difficulty, curricula, reward design, and long-horizon agent behavior.
  • Analyze failures and reward exploitation, and build evaluations that measure generalization.
  • Work with domain experts to turn scientific and knowledge-work workflows into reproducible training environments.
  • Show us your work by sharing a system, experiment, benchmark, paper, or open-source contribution you’re proud of.

Skills

Software engineering
Python
Containers
Data pipelines
Experiment infrastructure
Reinforcement learning
Coding agents
Experiment design

Tools

PyTorch

Job description

Klavis AI in San Francisco is seeking a software engineer with reinforcement learning exposure to build and evaluate long-horizon tasks and data pipelines. You’ll design multi-step environments, runtimes, and verifiers, develop pipelines for data generation, environment orchestration, agent rollouts, evaluation, and quality control at scale.

Candidates should show strong Python, containers, and experiment infrastructure skills, plus a track record of coding agents to build and debug substantial

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Engineer, RL Environments and Infrastructure
Research Engineer, RL Environments and Infrastructure

Hyphen Connect • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Research Engineer – RL Infrastructure & Agent Environments
Research Engineer – RL Infrastructure & Agent Environments

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 150,000 - 190,000
RL Infrastructure Engineer: Agent Environments & Evaluations
RL Infrastructure Engineer: Agent Environments & Evaluations

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 150,000 - 190,000
Member of Technical Staff – RL Environments & Evals
Member of Technical Staff – RL Environments & Evals

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 170,000 - 250,000
Evals Research Engineer – LLM Agents & RL Environments
Evals Research Engineer – LLM Agents & RL Environments

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 150,000 - 190,000
RL Infrastructure Engineer: Agent Environments & Evaluations
RL Infrastructure Engineer: Agent Environments & Evaluations

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 120,000 - 180,000
Senior RL Environment Architect for AI Evaluation (Remote)
Senior RL Environment Architect for AI Evaluation (Remote)

Clera Labs, Inc. • United States

Remote
USD 110,000 - 276,000
RL Systems Engineer: Environments & High-Throughput Pipelines
RL Systems Engineer: Environments & High-Throughput Pipelines

Hyphen Connect • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Senior Software Engineer, AI RL Environments
Senior Software Engineer, AI RL Environments

Mechanize • San Francisco (CA)

On-site
USD 150,000 - 230,000
Health insurance
Dental insurance
Vision insurance
+1
RL Environments & Evaluation Infrastructure Engineer
RL Environments & Evaluation Infrastructure Engineer

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 140,000 - 200,000