Staff Engineer - Environments & Post-Training Evaluation

hillclimb

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
Dental insurance
Vision insurance
401k match
Free lunch & dinner

Job summary

Hillclimb in San Francisco is seeking researchers to turn ML research problems into environments that reward a model for real progress and good research taste.

You will test whether each environment’s reward is repeatable and tracks the quality of the work it scores, build systems that create environments at scale and catch broken ones before training, and run post-training experiments to find trainable environments.

Qualifications

  • Prior experience with LLMs, RL, RLHF/RLAIF, RLVR, post-training, evals, graders, synthetic data, model training, or coding agents at a frontier/data lab.
  • Understanding of what makes a reward evaluation trustworthy, and how models exploit one that is not.
  • Background in designing automated systems for building, validating, and quality checking environments.

Responsibilities

  • Turn ML research problems into environments that reward a model for real progress and good research taste.
  • Test whether each environment’s reward is repeatable and tracks the quality of the work it scores.
  • Build systems that create environments at scale and catch broken ones before they reach training.
  • Run post-training experiments to find which environments are trainable.

Skills

LLMs
RL
RLHF/RLAIF
RLVR
post-training
evals
graders
synthetic data
model training
coding agents

Tools

Python

Job description

Hillclimb in San Francisco is seeking researchers to turn ML research problems into environments that reward a model for real progress and good research taste.

You will test whether each environment’s reward is repeatable and tracks the quality of the work it scores, build systems that create environments at scale and catch broken ones before training, and run post-training experiments to find trainable environments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Research Engineer — RL, LLMs & Evaluation Systems
Staff Research Engineer — RL, LLMs & Evaluation Systems

hillclimb • San Francisco (CA)

On-site
USD 150,000 - 230,000
Health insurance
Competitive 401k match
Free lunch & dinner
Member of Technical Staff - Environments & Post-Training
Member of Technical Staff - Environments & Post-Training

hillclimb • San Francisco (CA)

On-site
USD 180,000 - 240,000
Health insurance
Dental insurance
Vision insurance
+2
Member of Technical Staff - Research
Member of Technical Staff - Research

hillclimb • San Francisco (CA)

On-site
USD 150,000 - 230,000
Health insurance
Competitive 401k match
Free lunch & dinner
Research Engineer Intern: ML Evaluation & Data Pipelines
Research Engineer Intern: ML Evaluation & Data Pipelines

Thinklance LLP • San Francisco (CA)

On-site
USD 100,000 - 145,000
Meals stipend
Equinox gym membership
Laundry reimbursement
+1
Research Engineer – Distributed Training & RL Environment Infrastructure
Research Engineer – Distributed Training & RL Environment Infrastructure

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

Hybrid
USD 140,000 - 210,000
Founding equity
Health, dental and vision coverage
Flexible arrangements for Bay Area and
Research Engineer – Training and Environment Infrastructure
Research Engineer – Training and Environment Infrastructure

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

Hybrid
USD 120,000 - 180,000
Health, dental and vision coverage
Hybrid work arrangement
Research Engineer, RL Environments and Infrastructure
Research Engineer, RL Environments and Infrastructure

Hyphen Connect • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Founding ML Engineer — RL Environments for Hardware AI
Founding ML Engineer — RL Environments for Hardware AI

Rnb Consultancy • San Francisco (CA)

On-site
USD 150,000 - 250,000
Equity
Founding role
Production-Grade RL Environments Engineer
Production-Grade RL Environments Engineer

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 150,000 - 190,000
ML Engineer - RL Environments & Simulation Infrastructure
ML Engineer - RL Environments & Simulation Infrastructure

DeepRec.ai • San Francisco (CA)

On-site
USD 150,000 - 220,000
Equity