Member of Technical Staff - Environments & Post-Training

hillclimb

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
Dental insurance
Vision insurance
401k match
Free lunch & dinner

Job summary

Hillclimb in San Francisco is seeking researchers to turn ML research problems into environments that reward a model for real progress and good research taste.

You will test whether each environment’s reward is repeatable and tracks the quality of the work it scores, build systems that create environments at scale and catch broken ones before training, and run post-training experiments to find trainable environments.

Qualifications

  • Prior experience with LLMs, RL, RLHF/RLAIF, RLVR, post-training, evals, graders, synthetic data, model training, or coding agents at a frontier/data lab.
  • Understanding of what makes a reward evaluation trustworthy, and how models exploit one that is not.
  • Background in designing automated systems for building, validating, and quality checking environments.

Responsibilities

  • Turn ML research problems into environments that reward a model for real progress and good research taste.
  • Test whether each environment’s reward is repeatable and tracks the quality of the work it scores.
  • Build systems that create environments at scale and catch broken ones before they reach training.
  • Run post-training experiments to find which environments are trainable.

Skills

LLMs
RL
RLHF/RLAIF
RLVR
post-training
evals
graders
synthetic data
model training
coding agents

Tools

Python

Job description

About Hillclimb

Hillclimb’s mission is to improve agent capabilities towards recursive self-improvement. To do so, we work on creating environments and evals that test and push frontier models’ ability to ideate, experiment, and produce impactful research.

We’re a founding team of former DeepMind & quant researchers, backed by Tier 1 VCs, Jeff Dean, Paul Graham, Amjad Masad, and angel investors from OpenAI, Anthropic, DeepMind, xAI & Meta Superintelligence Labs.

About this role:

Your work will consist of the following and many more:

  • Turn ML research problems into environments that reward a model for real progress and good research taste

  • Test whether each environment’s reward is repeatable and tracks the quality of the work it scores

  • Build systems that create environments at scale and catch broken ones before they reach training

  • Run post-training experiments to find which environments are trainable

Preferred Experience:
  • Prior experience with LLMs, RL, RLHF/RLAIF, RLVR, post-training, evals, graders, synthetic data, model training, or coding agents at a frontier/data lab

  • Understanding of what makes a reward evaluation trustworthy, and how models exploit one that is not

  • Background in designing automated systems for building, validating, and quality checking environments.

Benefits:
  • Health, dental, vision insurance

  • Competitive 401k match

  • Free lunch & dinner

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff - Research
Member of Technical Staff - Research

hillclimb • San Francisco (CA)

On-site
USD 150,000 - 230,000
Health insurance
Competitive 401k match
Free lunch & dinner
Staff Engineer - Environments & Post-Training Evaluation
Staff Engineer - Environments & Post-Training Evaluation

hillclimb • San Francisco (CA)

On-site
USD 180,000 - 240,000
Health insurance
Dental insurance
Vision insurance
+2
Staff Research Engineer — RL, LLMs & Evaluation Systems
Staff Research Engineer — RL, LLMs & Evaluation Systems

hillclimb • San Francisco (CA)

On-site
USD 150,000 - 230,000
Health insurance
Competitive 401k match
Free lunch & dinner
RL Environments Engineer
RL Environments Engineer

bespokelabs • Mountain View (CA)

On-site
USD 250,000 - 300,000
Health insurance
Dental coverage
Vision coverage
+4
Member of Technical Staff - Research Engineer, RL Environments
Member of Technical Staff - Research Engineer, RL Environments

Preference Model • San Francisco (CA)

On-site
USD 170,000 - 260,000
Cash & equity compensation
Ownership & autonomy
Top ML engineers
+5
Member of Technical Staff - Research / Post-Training
Member of Technical Staff - Research / Post-Training

Halluminates • San Francisco (CA)

On-site
USD 250,000 - 320,000
Healthcare
Relocation stipend
401(k) match
+4
Research Engineer Intern - Environments, Data and Post-Training
Research Engineer Intern - Environments, Data and Post-Training

Thinklance LLP • San Francisco (CA)

On-site
USD 100,000 - 145,000
Meals stipend
Equinox gym membership
Laundry reimbursement
+1
Software Engineer - RL Environments San Francisco
Software Engineer - RL Environments San Francisco

AfterQuery • San Francisco (CA)

On-site
USD 160,000 - 210,000
Equity
Growth opportunities
Staff ML Engineer: RL Environments & Production Systems
Staff ML Engineer: RL Environments & Production Systems

Ambral • New York (NY)

On-site
USD 120,000 - 180,000
Significant equity and ownership
Equinox membership
Free meals, coffee, and snacks
+2
Member of Technical Staff - ML Infrastructure Engineer, RL Post-training
Member of Technical Staff - ML Infrastructure Engineer, RL Post-training

Preference Model, Inc. • San Francisco (CA)

On-site
USD 180,000 - 280,000
Competitive cash & equity ( >90th %ile
Ownership and autonomy
Work alongside senior staff from topML
+5