Frontier AI Safety Evaluator

Mercor; København; Remote; DKK 700,000 - 1,100,000; Full time

Job summary

Mercor is seeking experienced AI Safety Practitioners to evaluate safety, quality and alignment of frontier AI models on complex topics. You will assess AI-generated responses, apply safety policies, and help improve model behaviour through structured evaluations and feedback.

Responsibilities include evaluating safety and accuracy, reviewing sensitive content, refining RLHF/SFT rubrics, and providing actionable feedback. Collaborate with researchers and safety teams on ongoing initiatives.

Qualifications

• Bachelor's degree or higher in journalism, communications, psychology, public policy, law, biology, chemistry, CS or related field.
• 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, or related field.
• Excellent written English, critical thinking, and analytical reasoning.

Responsibilities

• Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and quality.
• Review content involving misinformation, political persuasion, self-harm, violence and other sensitive domains.
• Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
• Identify unsafe outputs, hallucinations and policy violations.
• Provide structured feedback to improve model alignment and safety performance.
• Collaborate with AI researchers and safety teams on evaluation initiatives.

Skills

AI Safety

Policy evaluation

Technical writing

Critical thinking

Education

Bachelor's degree or higher in a related field

Job description

Mercor is seeking experienced AI Safety Practitioners to evaluate safety, quality and alignment of frontier AI models on complex topics. You will assess AI-generated responses, apply safety policies, and help improve model behaviour through structured evaluations and feedback.

Responsibilities include evaluating safety and accuracy, reviewing sensitive content, refining RLHF/SFT rubrics, and providing actionable feedback. Collaborate with researchers and safety teams on ongoing initiatives.