Research Engineer

Klavis AI

San Francisco (CA)

On-site

USD 140,000 - 230,000

Full time

36 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Klavis AI in San Francisco is seeking a software engineer with reinforcement learning exposure to build and evaluate long-horizon tasks and data pipelines. You’ll design multi-step environments, runtimes, and verifiers, develop pipelines for data generation, environment orchestration, agent rollouts, evaluation, and quality control at scale.

Candidates should show strong Python, containers, and experiment infrastructure skills, plus a track record of coding agents to build and debug substantial

Qualifications

  • 3+ years of professional software engineering experience.
  • Strong Python and experience with containers, data pipelines, and reliable experiment infrastructure.
  • Hands-on work with reinforcement learning, model post-training, or agent evaluation; PyTorch experience.
  • Careful experimental judgment with clear baselines and controlled comparisons.
  • Track record of using coding agents to build, test, and debug substantial software.

Responsibilities

  • Build environments, datasets, and evaluations with the founders.
  • Develop pipelines for high-quality data generation, environment orchestration, agent rollouts, evaluation, and quality control at scale.
  • Run controlled experiments on task difficulty, curricula, reward design, and long-horizon agent behavior.
  • Analyze failures and reward exploitation, and build evaluations that measure generalization.
  • Work with domain experts to turn scientific and knowledge-work workflows into reproducible training environments.
  • Show us your work by sharing a system, experiment, benchmark, paper, or open-source contribution you’re proud of.

Skills

Software engineering
Python
Containers
Data pipelines
Experiment infrastructure
Reinforcement learning
Coding agents
Experiment design

Tools

PyTorch

Job description

Build environments, datasets, and evaluations with the founders. Study how task design, rewards, and verification affect learning across long-horizon coding, AI4Science, RSI, knowledge work, and agentic tool use.

What you’ll work on
  • Build realistic multi-step tasks, isolated runtimes, reference solutions, and verifiers, including environments in Harbor format.
  • Develop pipelines for high-quality data generation, environment orchestration, agent rollouts, evaluation, and quality control at scale.
  • Run controlled experiments on task difficulty, curricula, reward design, and long-horizon agent behavior.
  • Analyze failures and reward exploitation, and build evaluations that measure generalization.
  • Work with domain experts to turn scientific and knowledge-work workflows into reproducible training environments.
What you bring
  • 3+ years of professional software engineering experience.
  • Strong Python and experience with containers, data pipelines, and reliable experiment infrastructure.
  • Hands-on work with reinforcement learning, model post-training, or agent evaluation; experience with PyTorch or a similar framework.
  • Careful experimental judgment: clear baselines, controlled comparisons, and useful failure analysis.
  • A track record of using coding agents to build, test, and debug substantial software.
Show us your work

Share a system, experiment, benchmark, paper, or open-source contribution you’re proud of. Explain what you built, what failed, and what you learned.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Applied Research — Evaluations & Data
Applied Research — Evaluations & Data

Human Intuition Inc. • New York (NY)

On-site
USD 120,000 - 180,000
Software Engineer – AI Agent Evaluation
Software Engineer – AI Agent Evaluation

Workada • United States

Remote
USD 90,000 - 140,000
Member of Technical Staff, Evaluations
Member of Technical Staff, Evaluations

Bake AI Inc. • San Mateo (CA)

On-site
USD 180,000 - 240,000
Research Engineer, RL Env
Research Engineer, RL Env

Kindredventures • San Francisco (CA)

On-site
USD 140,000 - 220,000
Platform Engineer, RL & Eval Data | 100% remote
Platform Engineer, RL & Eval Data | 100% remote

anyone-ai • United States

Remote
USD 150,000 - 230,000
Research Engineer, RL Env
Research Engineer, RL Env

mecka • San Francisco (CA)

On-site
USD 140,000 - 210,000
Research Engineer, RL Environments and Infrastructure
Research Engineer, RL Environments and Infrastructure

Hyphen Connect • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Applied Research — RL & Agents
Applied Research — RL & Agents

Human Intuition Inc. • New York (NY)

On-site
USD 120,000 - 180,000
Member of Technical Staff - Research Engineering
Member of Technical Staff - Research Engineering

NextToken AI Inc. • Mountain View (CA)

On-site
USD 180,000 - 240,000
Research Engineer
Research Engineer

Orin Labs, Inc. • San Francisco (CA)

Hybrid
USD 150,000 - 210,000