Frontier LLM Evaluation Engineer - IC, Impact-Driven

Enclosure; San Francisco (CA); On-site; USD 150,000 - 230,000; Full time

Job summary

Enclosure in San Francisco is seeking an exceptional LLM evals researcher or engineer to own a significant portion of our LLM evals research as an IC. The role emphasizes exploration, curiosity, and practical impact in frontier AI security and model evaluation.

You will contribute to building robust evaluation environments and methods, collaborating with security and infrastructure teams to advance state-of-the-art AI safety and reliability.

Qualifications

• Hands-on experience designing and running evaluations for frontier AI systems.
• Experience building realistic evaluation environments, tasks, benchmarks, graders, or harnesses.
• Strong experimental judgment in designing rigorous evaluations.
• Experience evaluating tool-using agents, coding systems, and long-horizon tasks.
• Strong ML and software fundamentals; RL or model training a strong plus.

Skills

Evaluation design

Experimentation

RL / model training

Software engineering fundamentals

Agent evals

Job description

Enclosure in San Francisco is seeking an exceptional LLM evals researcher or engineer to own a significant portion of our LLM evals research as an IC. The role emphasizes exploration, curiosity, and practical impact in frontier AI security and model evaluation.

You will contribute to building robust evaluation environments and methods, collaborating with security and infrastructure teams to advance state-of-the-art AI safety and reliability.