Frontier AI Evaluation Research Engineer

Cerebro; San Francisco (CA); On-site; USD 270,000 - 330,000; Full time

Benefits offered by this job

Equity

Job summary

Frontier AI in San Francisco is seeking a Member of Technical Staff – Research to advance frontier-model evaluations, environments and reward mechanisms. You will work on designing challenging benchmarks, building interactive environments and scalable rewards to drive model improvement.

The role focuses on research and infrastructure development, not mere dashboarding, with equity upside and a highly technical team led by former Meta AI researchers.

Qualifications

• LLM evaluation, benchmark development or model capability assessment.
• Agentic systems, tool-use environments or multi-step reasoning.
• Reinforcement learning, RLHF, GRPO, reward modelling or verifiable rewards.
• Synthetic data generation, automated evaluation or executable verification.
• Post-training research and evaluation-to-training pipelines.

Responsibilities

• Design agent evaluations and benchmarks exposing frontier models’ limits.
• Develop interactive RL environments with meaningful learning signals.
• Explore scalable reward design and verification techniques.
• Use evaluation results to inform data generation, training and model improvement.
• Investigate frontier-model capabilities, generalisation and robustness.

Skills

LLM evaluation

Benchmark development

Reinforcement learning

Research engineering

Job description

Frontier AI in San Francisco is seeking a Member of Technical Staff – Research to advance frontier-model evaluations, environments and reward mechanisms. You will work on designing challenging benchmarks, building interactive environments and scalable rewards to drive model improvement.

The role focuses on research and infrastructure development, not mere dashboarding, with equity upside and a highly technical team led by former Meta AI researchers.