AI Safety Evaluation Expert — Remote Contract

Mercor; San Francisco (CA); Hybrid; GBP 63,000 - 73,000; Part time

Job summary

Mercor is seeking an AI Safety Practitioner to remotely evaluate AI-generated responses for safety, accuracy, and policy compliance. You will review content across misinformation, self-harm, violence, cyber, biosecurity, and other sensitive areas using established rubrics.

You will collaborate with AI researchers and safety teams to provide actionable feedback and help improve model alignment and safety performance on ongoing evaluation initiatives.

Qualifications

• Bachelor's degree or higher in a related discipline.
• 5+ years of professional AI safety or related experience.
• Excellent written English and strong analytical reasoning.
• Ability to evaluate nuanced policy-sensitive scenarios.

Responsibilities

• Evaluate AI-generated responses for safety, accuracy, policy compliance.
• Review content involving misinformation, self-harm, violence, cyber, biosecurity, and other sensitive domains.
• Apply evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
• Identify unsafe outputs and policy violations.
• Provide structured feedback to improve model alignment and safety performance.
• Collaborate with AI researchers and safety teams.

Skills

Excellent written English

Critical thinking

Analytical reasoning

5+ years AI Safety experience

Education

Bachelor's degree or higher

Job description

Mercor is seeking an AI Safety Practitioner to remotely evaluate AI-generated responses for safety, accuracy, and policy compliance. You will review content across misinformation, self-harm, violence, cyber, biosecurity, and other sensitive areas using established rubrics.

You will collaborate with AI researchers and safety teams to provide actionable feedback and help improve model alignment and safety performance on ongoing evaluation initiatives.