Member of Technical Staff - Research

hillclimb

San Francisco (CA)

On-site

USD 150,000 - 230,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health insurance
Competitive 401k match
Free lunch & dinner

Job summary

Hillclimb is building environments and evals to push frontier models toward real scientific progress. We seek a motivated researcher to turn ML research problems into scalable, automated evaluation environments.

You will design repeatable rewards and build systems that catch flaws before training. You will collaborate with a founding team of researchers, contribute to post-training analyses, and help shape the evaluation framework for frontier models.

Qualifications

  • Experience turning ML research problems into automated evaluation environments.
  • Understanding of reward design and trustworthy evaluation methods.
  • Background building scalable systems for environment generation and validation.

Responsibilities

  • Turn ML research problems into environments that reward real progress and good research taste.
  • Test reward repeatability and track quality of work it scores.
  • Build systems that create environments at scale and catch broken ones before training.
  • Run post-training experiments to identify trainable environments.

Skills

LLMs
Reinforcement Learning
RLHF/RLAIF
RLVR
Post-training
Evals
Graders
Synthetic data
Model training
Coding agents

Job description

About Hillclimb

Hillclimb’s mission is to improve agent capabilities towards recursive self-improvement. To do so, we work on creating environments and evals that test and push frontier models’ ability to ideate, experiment, and produce impactful research.

We’re a founding team of former DeepMind & quant researchers, backed by Tier 1 VCs, Jeff Dean, Paul Graham, Amjad Masad, and angel investors from OpenAI, Anthropic, DeepMind, xAI & Meta Superintelligence Labs.

About this role:

Your work will consist of the following and many more:

  • Turn ML research problems into environments that reward a model for real progress and good research taste

  • Test whether each environment’s reward is repeatable and tracks the quality of the work it scores

  • Build systems that create environments at scale and catch broken ones before they reach training

  • Run post-training experiments to find which environments are trainable

Preferred Experience:
  • Prior experience with LLMs, RL, RLHF/RLAIF, RLVR, post-training, evals, graders, synthetic data, model training, or coding agents at a frontier/data lab

  • Understanding of what makes a reward evaluation trustworthy, and how models exploit one that is not

  • Background in designing automated systems for building, validating, and quality checking environments.

Benefits:
  • Health, dental, vision insurance

  • Competitive 401k match

  • Free lunch & dinner

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff - Environments & Post-Training
Member of Technical Staff - Environments & Post-Training

hillclimb • San Francisco (CA)

On-site
USD 180,000 - 240,000
Health insurance
Dental insurance
Vision insurance
+2
Staff Research Engineer — RL, LLMs & Evaluation Systems
Staff Research Engineer — RL, LLMs & Evaluation Systems

hillclimb • San Francisco (CA)

On-site
USD 150,000 - 230,000
Health insurance
Competitive 401k match
Free lunch & dinner
Staff Engineer - Environments & Post-Training Evaluation
Staff Engineer - Environments & Post-Training Evaluation

hillclimb • San Francisco (CA)

On-site
USD 180,000 - 240,000
Health insurance
Dental insurance
Vision insurance
+2
Member of Technical Staff - Research / Post-Training
Member of Technical Staff - Research / Post-Training

Halluminates • San Francisco (CA)

On-site
USD 250,000 - 320,000
Healthcare
Relocation stipend
401(k) match
+4
Member of Technical Staff - Research Engineer, RL Environments
Member of Technical Staff - Research Engineer, RL Environments

Preference Model • San Francisco (CA)

On-site
USD 170,000 - 260,000
Cash & equity compensation
Ownership & autonomy
Top ML engineers
+5
Member of Technical Staff - ML Infrastructure Engineer, RL Post-training
Member of Technical Staff - ML Infrastructure Engineer, RL Post-training

Preference Model, Inc. • San Francisco (CA)

On-site
USD 180,000 - 280,000
Competitive cash & equity ( >90th %ile
Ownership and autonomy
Work alongside senior staff from topML
+5
Member of Technical Staff, Evals
Member of Technical Staff, Evals

Handshake • New York (NY)

Hybrid
USD 200,000 - 350,000
Equity
401(k) match
Parental benefits
+10
Member of Technical Staff - Research Engineer, Post-training
Member of Technical Staff - Research Engineer, Post-training

Preference Model • San Francisco (CA)

On-site
USD 180,000 - 240,000
Competitive cash and equity (>90th pct
Ownership and autonomy
Lunch onsite
+4
Member of Technical Staff, Evals
Member of Technical Staff, Evals

Handshake • United States

Hybrid
USD 200,000 - 350,000
Ownership equity in a fast-growing公司
401(k) match & competitive comp.
Paid parental leave & fertility-benefi
+5
Research Engineer Intern - Environments, Data and Post-Training
Research Engineer Intern - Environments, Data and Post-Training

Thinklance LLP • San Francisco (CA)

On-site
USD 100,000 - 145,000
Meals stipend
Equinox gym membership
Laundry reimbursement
+1