Model Safety & Evaluation Program Lead (0→1)

Sierra Ventures; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Top-tier compensation

Stock options

Health & wellness

Meals provided

Parental leave

Unlimited PTO (US) / 30 days (UK)

Visa sponsorship

Team building

Job summary

Reflection is building model evals and safety from the ground up, and this RPM will be at the center of that effort. You will shape the evaluation frameworks, operational infrastructure for safety, and processes linking evals to model development.

You bring a first-responder mentality and will define how Reflection interfaces with the broader safety ecosystem, coordinating across research and engineering to accelerate frontier model progress responsibly.

Qualifications

• 7+ years of experience in technical program management, research operations, or ML engineering.
• Familiar with the landscape of model evaluation and AI safety, including evaluation methodologies, red-teaming, alignment research, and the evolving regulatory and industry safety ecosystem.
• Deep enough technically to engage with researchers and engineers on topics like model behavior, evaluation design, data pipelines, and safety-critical system architecture.
• Proven ability to build structures where none exists, turning ambiguous mandates into functioning programs with clear ownership and measurable outcomes.
• Strong stakeholder management spanning technical ICs, research leadership, and external partners.
• Excited to build from zero to one and define how model safety and evaluation works at Reflection.

Responsibilities

• Build the foundational infrastructure for model evals and safety, defining evaluation frameworks, tooling requirements, and operational processes.
• Stand up model safety operations as a function, including workflows, review cadences, and decision frameworks.
• Partner with research and engineering leads to embed safety and evaluation checkpoints into the development process.
• Drive the scoping and prioritization of eval science and infra investments, deciding what to build in-house or adopt.
• Establish Reflection's engagement with the external safety ecosystem, including collaborations with academia and industry frameworks.
• Create visibility and reporting structures for leadership on safety status, evaluation coverage, and open risks.
• Champion blameless post-mortems and continuous learning to improve systems and processes.

Skills

Program management

Research operations

ML engineering

Job description

Reflection is building model evals and safety from the ground up, and this RPM will be at the center of that effort. You will shape the evaluation frameworks, operational infrastructure for safety, and processes linking evals to model development.

You bring a first-responder mentality and will define how Reflection interfaces with the broader safety ecosystem, coordinating across research and engineering to accelerate frontier model progress responsibly.