AI Safety Evaluation Expert Remote RLHF & Policy Review

mercor; España; Remote; EUR 74,000 - 86,000; Part time

Job summary

Mercor is seeking an AI Safety Practitioner for a remote contract role. You will evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality, including content in sensitive domains and complex prompts.

The ideal candidate holds a Bachelor's degree or higher in a related field and 5+ years of experience in AI Safety, Trust & Safety, journalism, public policy, or scientific research, plus excellent written English and strong analytical reasoning.

Qualifications

• Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
• 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.
• Excellent written English, critical thinking, and analytical reasoning skills.
• Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Responsibilities

• Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
• Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
• Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking .
• Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
• Provide structured feedback to improve model alignment and safety performance.
• Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Skills

AI Safety

Trust & Safety

Critical thinking

Analytical reasoning

Excellent written English

Education

Bachelor's degree or higher in a related discipline

Job description

Mercor is seeking an AI Safety Practitioner for a remote contract role. You will evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality, including content in sensitive domains and complex prompts.

The ideal candidate holds a Bachelor's degree or higher in a related field and 5+ years of experience in AI Safety, Trust & Safety, journalism, public policy, or scientific research, plus excellent written English and strong analytical reasoning.