LLM Evaluation Scientist - Post-Training & Reasoning

Cerebro; San Francisco (CA); On-site; USD 160,000 - 230,000; Full time

Job summary

Cerebro, a research-focused AI company in San Francisco, seeks a Research Scientist / Member of Technical Staff for LLM Evaluation & Post-Training. You will tackle the limitations of current evaluation methods as models improve at multi-step reasoning, tool use, and autonomous task execution.

You will work with a small, technically strong team, owning the problems you investigate and the methods you develop.

Qualifications

• Original research in LLMs, reinforcement learning, post-training, reasoning or evaluation.
• Experience bridging theory and hands-on experimentation in AI research.

Responsibilities

• Develop and evaluate robust methods for LLM evaluation and post-training.
• Design experiments to measure reasoning, tool use and autonomous task execution.
• Build scalable research infrastructure for experimental evaluation at scale.
• Contribute to publications and share findings with the team and broader community.

Job description

Cerebro, a research-focused AI company in San Francisco, seeks a Research Scientist / Member of Technical Staff for LLM Evaluation & Post-Training. You will tackle the limitations of current evaluation methods as models improve at multi-step reasoning, tool use, and autonomous task execution.

You will work with a small, technically strong team, owning the problems you investigate and the methods you develop.