AI Safety Evaluator: Frontier Model Alignment Expert

Mercor; Amsterdam; On-site; EUR 70,000 - 110,000; Full time

Job summary

Mercor is seeking experienced AI Safety Practitioners to evaluate frontier model safety, quality, and alignment across policy-sensitive topics. You will assess AI-generated responses and help improve model behavior through structured evaluations and feedback.

Responsibilities include evaluating safety, reviewing misinformation and sensitive domains, applying RLHF/SFT rubrics, and collaborating with AI researchers to advance safety benchmarks. Excellent written English required.

Qualifications

• Bachelor's degree or higher in a related field.
• 5+ years of professional experience in AI Safety or a related field.
• Excellent written English and analytical reasoning.
• Ability to evaluate nuanced and policy-sensitive scenarios.

Responsibilities

• Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
• Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
• Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
• Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
• Provide structured feedback to improve model alignment and safety performance.
• Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Skills

Critical thinking

Analytical reasoning

Policy evaluation

English proficiency

Education

Bachelor's degree or higher in a related discipline

Job description

Mercor is seeking experienced AI Safety Practitioners to evaluate frontier model safety, quality, and alignment across policy-sensitive topics. You will assess AI-generated responses and help improve model behavior through structured evaluations and feedback.

Responsibilities include evaluating safety, reviewing misinformation and sensitive domains, applying RLHF/SFT rubrics, and collaborating with AI researchers to advance safety benchmarks. Excellent written English required.