Frontier AI Safety Evaluator: Expert Reviewer

Mercor; Brussel Hoofdstad; Sur place; EUR 70 000 - 110 000; Plein temps

Résumé du poste

Mercor is seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback.

You will evaluate outputs for safety, accuracy, and policy compliance, review content in high-risk domains, and collaborate with AI researchers to refine evaluation rubrics and safety benchmarks.

Qualifications

• Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
• 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.
• Excellent written English, critical thinking, and analytical reasoning skills.
• Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Responsabilités

• Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
• Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
• Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
• Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
• Provide structured feedback to improve model alignment and safety performance.
• Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Connaissances

Analytical thinking

Critical thinking

Written English

Policy evaluation

Nuanced reasoning

Formation

Bachelor's degree or higher in a relevant discipline

Description du poste

Mercor is seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback.

You will evaluate outputs for safety, accuracy, and policy compliance, review content in high-risk domains, and collaborate with AI researchers to refine evaluation rubrics and safety benchmarks.