Frontier AI Safety Evaluator & Model Alignment Lead

Obsidian

Amsterdam

On-site

EUR 70,000 - 110,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Obsidian is seeking experienced AI Safety Practitioners in Amsterdam to evaluate frontier models for safety, quality, and alignment across nuanced topics. You will assess AI-generated responses, apply safety policies, and provide structured feedback to improve model behavior.

The role involves evaluating misinformation, sensitive domains, and applying rubrics for RLHF, SFT, and AI safety benchmarking, with collaboration across AI researchers and safety teams.

Qualifications

  • Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
  • 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or related field.
  • Excellent written English, critical thinking, and analytical reasoning skills.

Responsibilities

  • Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
  • Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
  • Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
  • Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
  • Provide structured feedback to improve model alignment and safety performance.
  • Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Skills

Excellent written English
Critical thinking
Analytical reasoning

Education

Bachelor's degree or higher in a related discipline

Job description

Obsidian is seeking experienced AI Safety Practitioners in Amsterdam to evaluate frontier models for safety, quality, and alignment across nuanced topics. You will assess AI-generated responses, apply safety policies, and provide structured feedback to improve model behavior.

The role involves evaluating misinformation, sensitive domains, and applying rubrics for RLHF, SFT, and AI safety benchmarking, with collaboration across AI researchers and safety teams.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Safety Evaluator: Frontier Model Alignment Expert
AI Safety Evaluator: Frontier Model Alignment Expert

Mercor • Amsterdam

On-site
EUR 70,000 - 110,000
Frontier AI Safety Evaluator
Frontier AI Safety Evaluator

Mercor • Amsterdam

On-site
EUR 90,000 - 120,000
Senior Frontier AI Safety Red Teamer
Senior Frontier AI Safety Red Teamer

Obsidian • Amsterdam

Remote
EUR 90,000 - 130,000
AI Safety Practitioner - Expert Evaluator
AI Safety Practitioner - Expert Evaluator

Mercor • Amsterdam

On-site
EUR 70,000 - 110,000
AI Safety Specialist - Evaluation Expert
AI Safety Specialist - Evaluation Expert

Mercor • Amsterdam

On-site
EUR 90,000 - 120,000
AI Safety Specialist - Evaluation Expert
AI Safety Specialist - Evaluation Expert

Obsidian • Amsterdam

On-site
EUR 70,000 - 110,000
Frontier AI Safety Red Team Specialist
Frontier AI Safety Red Team Specialist

Mercor • Amsterdam

On-site
EUR 90,000 - 130,000
AI Safety Red Teamer Expert
AI Safety Red Teamer Expert

Mercor • Amsterdam

On-site
EUR 90,000 - 130,000
AI Model Evaluator for Frontier DevOps & Infra
AI Model Evaluator for Frontier DevOps & Infra

Mercor • Amsterdam

On-site
EUR 167,000 - 215,000
AI Safety Specialist - Fully Remote | Upto $84/hr
AI Safety Specialist - Fully Remote | Upto $84/hr

Obsidian • Amsterdam

Remote
EUR 90,000 - 130,000