Remote Coding RL Engineer for AI Benchmarking

Clera; Oregon; Hybrid; USD 120,000 - 160,000; Full time

Job summary

Clera is seeking a Coding RL Engineer to join our early‑stage AI team. You will transform real‑world software work into reproducible benchmarks for training and evaluating coding models, delivering containerized environments and tasks for automated testing.

You will collaborate with researchers to calibrate task difficulty, design verifiers, and accelerate task creation and validation while ensuring robustness against flaky tests and leaks. Remote within the US or based in San Francisco.

Qualifications

• 2+ years of professional software engineering experience delivering software systems.
• Strong Python proficiency and one of TypeScript/Go/Java/Rust.
• Hands-on Docker experience and familiarity with reproducible build/test environments.
• Experience navigating unfamiliar, complex codebases and getting them building, running, and tested.
• Experience with coding model training and evaluation (SWE-bench-style tasks, code evaluations, RLVR, agent harnesses).
• Experience creating coding tasks from real engineering work and hardening verifiers against flaky tests/leaked solutions.
• Experience with frontier AI labs, evaluation teams, RL environments, coding agents, or large enterprise/legacy codebases is helpful.

Responsibilities

• Convert licensed production codebases into reproducible, containerized coding environments.
• Create tasks from issues, PRs, commit histories, and incident records for bugs, features, refactors, testing, and multi-file agent work.
• Build and improve verifiers with hidden tests, rubric-based or model-based grading, and safeguards against reward hacking and answer leakage.
• Run model rollouts, review traces, and repair or remove tasks that are broken, ambiguous, too easy, or exploitable.
• Contribute tasks and analysis to coding benchmarks and build tools that speed up task creation and validation.
• Work with research teams to calibrate task difficulty and benchmark coverage.

Skills

Python

TypeScript

Go

Java

Rust

Docker

Reproducible builds

Codebase navigation

RL evaluation

Task creation

Tools

Docker

Job description

Clera is seeking a Coding RL Engineer to join our early‑stage AI team. You will transform real‑world software work into reproducible benchmarks for training and evaluating coding models, delivering containerized environments and tasks for automated testing.

You will collaborate with researchers to calibrate task difficulty, design verifiers, and accelerate task creation and validation while ensuring robustness against flaky tests and leaks. Remote within the US or based in San Francisco.