Senior Specialist / Manager, AI Safety Data and Evaluation Program

SyncScribes

Greater London

On-site

GBP 67,000 - 109,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Bonus potential
Equity opportunities
Comprehensive benefits

Job summary

Lila Sciences is building a centered AI safety team to manage scientific risk, partner with researchers and external experts, and run data-driven safety evaluations. You will help design and execute safety strategies, ensure high-quality outputs, and influence leadership decisions.

The role focuses on program execution, data quality, and collaboration across science, model training and lab integration, with potential equity components for early-stage contributions.

Qualifications

  • Experience delivering expert-data, research-operations, evaluation or similarly demanding programs involving specialist contributors.
  • A substantial working understanding of AI safety, including threat models, capability evaluations, red teaming and safeguards.
  • Evidence of applying this safety understanding in research, evaluation or expert-data work.
  • Strong operational judgment and the ability to manage dependencies and multiple workstreams.
  • Track record of setting measurable quality standards and improving processes that produce data.
  • Clear communication and documentation for collaboration with researchers, experts and vendors.

Responsibilities

  • Translate scientific briefs into executable plans with clear milestones and quality standards.
  • Coordinate external experts and access to internal expertise within the organization.
  • Oversee contributor onboarding, task assignment, training and support.
  • Run expert-data collection, red-teaming and evaluation programs and monitor progress.
  • Maintain records, versioned guidance and datasets; improve workflows based on feedback.
  • Identify questions needing scientific escalation and route to appropriate specialists.

Skills

Expert-data programs
AI safety
Threat modelling
Quality standards
Stakeholder management
Documentation
Communications with researchers

Job description

Your Impact at LILA

We're building a talent-dense, high-agency AI safety team at Lila that will engage all core teams within the organization (science, model training, lab integration, etc.), to identify and mitigate risks from scientific superintelligence while retaining the core scientific discovery capabilities of the stack. The initial focus of this team will be to build and implement a bespoke safety strategy for Lila, tailored to its specific goals and deployment strategies. This will involve technical safety strategy development, broader ecosystem engagement, safety-focused evaluations, safety systems to mitigate risks, and a research agenda that explores longer-term needs such as oversight of superintelligent scientific systems.

High-quality safety depends on the right expertise, consistent and repeatable workflows and high levels of interpretability. At Lila Sciences, you will turn scientific risk questions into well-run expert-data and evaluation programs to build this evidence-base.

You will bring a strong working understanding of AI safety and scientific misuse risks to connect internal risk mapping and threat modeling with expertise across Lila and external specialists. Your primary responsibilities will be program execution and data quality: organizing contributors, running red-teaming and evaluation campaigns, and ensuring their outputs meet agreed standards. You will also be responsible for gathering targeted high-impact feedback from partners in the AI Safety community on our different aspects of our approach to Safety. You will work closely with scientists who frame the research questions and interpret their significance, while creating the operational conditions for their expertise to have an impact. Ultimately, you will play a key role in generating the evidence that informs safety decisions made by senior leadership at Lila.

What You'll Be Building
  • Translate agreed scientific briefs into executable plans covering tasks, contributor needs, instructions, milestones, quality standards and delivery expectations.
  • Source and coordinate external experts with scientific colleagues, and organize access to relevant expertise within Lila.
  • Manage contributor onboarding, task assignment, training and support so specialists can contribute effectively and consistently.
  • Run expert-data collection, annotation, red-teaming and evaluation programs, tracking progress and resolving delivery problems.
  • Establish quality controls covering completeness, consistency, provenance and adherence to rubrics; coordinate calibration, review, disagreement resolution and rework with scientific owners.
  • Maintain clear records, versioned guidance and usable datasets, and improve workflows based on quality findings and researcher feedback.
  • Identify questions that require scientific judgment and bring them to the appropriate specialists, ensuring decisions are reflected in program materials and subsequent work.
What You'll Need to Succeed
  • Experience delivering expert-data, research-operations, evaluation or similarly demanding programs involving specialist contributors.
  • A substantial working understanding of AI safety, including how threat models, capability evaluations, red teaming and safeguards inform one another. You should be able to interpret a safety research brief, recognize its assumptions and the consequences of data-quality failures, and identify when a question needs scientific escalation.
  • Evidence of applying this safety understanding in research, evaluation or expert-data work, including how it shaped the scoping, execution or review of a program.
  • Strong operational judgment and the ability to manage dependencies, changing requirements and several parallel workstreams.
  • A track record of setting measurable quality standards, detecting recurring problems and improving the processes that produce data.
  • Clear communication, careful documentation and the ability to build effective relationships with researchers, experts and vendors.
  • Sufficient technical and scientific fluency to understand research briefs, clarify ambiguity and work productively with subject-matter experts.
Bonus Points For
  • Experience contributing to scientific study design, assessing scientific validity or developing evaluation rubrics.
  • Deeper scientific expertise or research experience in biology, chemistry or materials science.
  • Data analysis, scripting, annotation platforms or tools for tracking research workflows and data provenance.
Compensation

We offer competitive base compensation with bonus potential and generous early-stage equity. Your final offer will reflect your background, expertise, and expected impact.

U.S. Benefits.

Full-time U.S. employees receive a comprehensive benefits program including medical, dental, and vision coverage; employer-paid life and disability insurance; flexible time off with generous company wide holidays; paid parental leave; an educational assistance program; commuter benefits, including bike share memberships for office based employees; and a company subsidized lunch program.

International Benefits.

Full-time employees outside the U.S. receive a comprehensive benefits program tailored to their region. USD salary ranges apply only to U.S.-based positions; international salaries are set to local market.

$88,000 – $144,000 USD

About LILA

Lila Sciences is building Scientific Superintelligence™ to solve humankind's greatest challenges. We believe science is the most inspiring frontier for AI. Rather than hard-coding expert knowledge into tools, LILA builds systems that can learn for themselves.

LILA combines advanced AI models with proprietary AI Science Factory™ instruments into an operating system for science that executes the entire scientific method autonomously, accelerating discovery at unprecedented speed, scale, and impact across medicine, materials, and energy. Learn more at www.lila.ai.

Guided by our core values of truth, trust, curiosity, grit, and velocity, we move with startup speed while tackling problems of historic importance.

We're All In

Lila Sciences is committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.

Information you provide during your application process will be handled in accordance with our Candidate Privacy Policy.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff / Principal Research Engineer, AI Safety Mitigations
Staff / Principal Research Engineer, AI Safety Mitigations

SyncScribes • Greater London

Remote
GBP 169,000 - 254,000
Staff / Principal Research Engineer, AI Safety Mitigations
Staff / Principal Research Engineer, AI Safety Mitigations

Lila Sciences, Inc. • Greater London

On-site
GBP 168,000 - 252,000
Research Scientist / Research Engineer, Automated Safety
Research Scientist / Research Engineer, Automated Safety

Lilasciences • Greater London

Hybrid
GBP 90,000 - 150,000
Equity
Senior / Principal Computational Biologist, AI Safety
Senior / Principal Computational Biologist, AI Safety

Lilasciences • Greater London

On-site
GBP 200,000 - 287,000
Comprehensive benefits
Equity opportunity
Staff / Principal Security Engineer, AI Safety and Security
Staff / Principal Security Engineer, AI Safety and Security

SyncScribes • Greater London

On-site
GBP 192,000 - 306,000
Bonus potential
Early-stage equity
Comprehensive benefits
Senior/ Principal Research Scientist, AI Safety, Biological/ Physical Sciences
Senior/ Principal Research Scientist, AI Safety, Biological/ Physical Sciences

Lila Sciences • Greater London

Hybrid
GBP 100,000 - 170,000
Senior / Principal Materials Scientist, AI Safety
Senior / Principal Materials Scientist, AI Safety

Lilasciences • Greater London

Hybrid
GBP 200,000 - 287,000
Equity
Bonus potential
ML Research Scientist, Environments & Harnesses
ML Research Scientist, Environments & Harnesses

Lila Sciences • Greater London

On-site
GBP 170,000 - 227,000
Equity
Technical Recruiter, AI Research
Technical Recruiter, AI Research

Lila Sciences • Cambridge

On-site
GBP 121,000 - 162,000
Equity
Bonus potential
International benefits
Director/Senior Director, Molecular Discovery
Director/Senior Director, Molecular Discovery

DeepCamp • Greater London

On-site
USD 202,000 - 323,000
Medical/Dental/Vision
Life & Disability Insurance
Flexible time off
+5