Remote AI Safety Evaluator & Policy Reviewer

Mercor; Viseu; Remote; EUR 74,000 - 86,000; Part time

Job summary

Mercor is seeking an AI Safety Specialist to work remotely. You will evaluate AI-generated responses for safety, accuracy, and policy compliance, supporting model alignment and safety benchmarks.

In this contract role, you will review content across sensitive domains, refine evaluation rubrics for RLHF and SFT, and provide structured feedback to researchers. Strong English writing and analytical skills are essential.

Qualifications

• Must hold Bachelor's degree or higher in a related discipline.
• 5+ years of professional experience in AI Safety or related fields.
• Excellent written English and analytical reasoning skills.
• Ability to evaluate nuanced and policy-sensitive scenarios.

Responsibilities

• Evaluate AI-generated responses for safety, factual accuracy, policy compliance and quality.
• Review content on misinformation, political persuasion, self-harm, violence, cyber, biosecurity and other sensitive domains.
• Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
• Identify unsafe outputs, hallucinations, and policy violations; provide structured feedback.
• Collaborate with AI researchers and safety teams on evaluation initiatives.

Skills

Written English

Critical thinking

Analytical reasoning

Policy evaluation

Education

Bachelor's degree or higher

Job description

Mercor is seeking an AI Safety Specialist to work remotely. You will evaluate AI-generated responses for safety, accuracy, and policy compliance, supporting model alignment and safety benchmarks.

In this contract role, you will review content across sensitive domains, refine evaluation rubrics for RLHF and SFT, and provide structured feedback to researchers. Strong English writing and analytical skills are essential.