AI Safety Evaluator — Expert Policy Reviewer (Remote)

mercor; Belgique; Remote; EUR 74,000 - 86,000; Full time

Job summary

Mercor is hiring an AI Safety Practitioner for a remote contract role. You will evaluate AI outputs for safety, accuracy, and policy compliance, and contribute to ongoing evaluation programs with researchers and safety teams.

The position requires a strong background in AI Safety, policy analysis, and excellent written English. Remote work flexibility is offered, with compensation on an hourly basis.

Qualifications

• Bachelor's degree or higher in a related discipline.
• 5+ years of professional experience in AI Safety or related fields.
• Excellent written English and strong analytical skills.
• Ability to evaluate nuanced policy-sensitive scenarios.

Responsibilities

• Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
• Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
• Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
• Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
• Provide structured feedback to improve model alignment and safety performance.
• Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Skills

English proficiency

Critical thinking

Analytical reasoning

Policy evaluation

Education

Bachelor's degree or higher

Tools

RLHF

SFT

AI safety benchmarking

Job description

Mercor is hiring an AI Safety Practitioner for a remote contract role. You will evaluate AI outputs for safety, accuracy, and policy compliance, and contribute to ongoing evaluation programs with researchers and safety teams.

The position requires a strong background in AI Safety, policy analysis, and excellent written English. Remote work flexibility is offered, with compensation on an hourly basis.