Remote AI Safety Evaluation Specialist (Contract)

mercor; Österreich; Remote; EUR 74.000 - 86.000; Vollzeit

Zusammenfassung

Mercor seeks an AI Safety Practitioner to evaluate AI-generated outputs for safety, accuracy, and policy compliance. You will review content across sensitive domains and help refine evaluation rubrics for RLHF, SFT, and benchmarking.

Applicants should have a strong background in AI safety, journalism, policy, or related research, plus excellent written English and analytical thinking. This is a remote, contract position with competitive hourly compensation.

Qualifikationen

• Bachelor's degree or higher in a related field.
• 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, science, or security.
• Excellent written English, critical thinking, and analytical reasoning skills.
• Ability to evaluate nuanced, policy-sensitive scenarios consistently.

Aufgaben

• Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
• Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
• Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
• Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
• Provide structured feedback to improve model alignment and safety performance.
• Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Ausbildung

Bachelor's degree or higher

Jobbeschreibung

Mercor seeks an AI Safety Practitioner to evaluate AI-generated outputs for safety, accuracy, and policy compliance. You will review content across sensitive domains and help refine evaluation rubrics for RLHF, SFT, and benchmarking.

Applicants should have a strong background in AI safety, journalism, policy, or related research, plus excellent written English and analytical thinking. This is a remote, contract position with competitive hourly compensation.