Remote AI Safety Evaluator & Model Alignment Expert

Mercor; San Francisco (CA); Hybrid; GBP 62,000 - 72,000; Full time

Job summary

Mercor is seeking an AI Safety Practitioner for a remote contract role. You will evaluate AI-generated responses for safety, accuracy, and policy compliance, covering sensitive domains. You will collaborate with AI researchers and safety teams to refine evaluation rubrics and improve model alignment.

Must have 5+ years in AI Safety or related fields and a Bachelor's degree in a relevant discipline. Excellent English writing and analytic skills are required; flexible remote work across time zones

Qualifications

• Bachelor's degree or higher in a relevant discipline.
• 5+ years of professional AI Safety or related experience.
• Excellent written English and analytical skills.
• Ability to evaluate nuanced policy-sensitive scenarios.

Responsibilities

• Evaluate AI-generated responses for safety, accuracy, and quality.
• Review content across misinformation, political persuasion, self-harm, violence, etc.
• Apply evaluation rubrics for RLHF, SFT, and safety benchmarking.
• Identify unsafe outputs and policy violations.
• Provide structured feedback to improve alignment and safety performance.
• Collaborate with AI researchers and safety teams on evaluation initiatives.

Skills

English proficiency

Critical thinking

Analytical reasoning

Policy evaluation

Education

Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or related discipline

Job description

Mercor is seeking an AI Safety Practitioner for a remote contract role. You will evaluate AI-generated responses for safety, accuracy, and policy compliance, covering sensitive domains. You will collaborate with AI researchers and safety teams to refine evaluation rubrics and improve model alignment.

Must have 5+ years in AI Safety or related fields and a Bachelor's degree in a relevant discipline. Excellent English writing and analytic skills are required; flexible remote work across time zones