Frontier AI Safety Evaluator & Policy Risk Analyst

Mercor; Zürich; Remote; CHF 120.000 - 180.000; Vollzeit

Zusammenfassung

Mercor seeks experienced AI Safety Practitioners to assess the safety, quality, and alignment of frontier AI models on complex and policy-sensitive topics. You will evaluate AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback.

Responsibilities include applying evaluation rubrics for RLHF, SFT, and benchmarking; identifying unsafe outputs and policy violations; and collaborating with AI researchers and safety teams to drive

Qualifikationen

• Bachelor's degree or higher in a related field.
• Excellent written English and strong analytical skills.
• Ability to evaluate nuanced policy-sensitive scenarios.
• Experience with AI safety or risk assessment is a plus.

Aufgaben

• Evaluate AI-generated responses for safety, accuracy, policy compliance, and quality.
• Review content across safety, misinformation, self-harm, violence, and other sensitive domains.
• Apply and refine evaluation rubrics for RLHF, SFT, and safety benchmarking.
• Identify unsafe outputs, hallucinations, and policy violations.
• Provide structured feedback to improve model alignment and safety performance.
• Collaborate with researchers and safety teams on ongoing evaluation initiatives.

Kenntnisse

Critical thinking

Analytical reasoning

Policy evaluation

Structured evaluation

Ausbildung

Bachelor's degree or higher

Jobbeschreibung

Mercor seeks experienced AI Safety Practitioners to assess the safety, quality, and alignment of frontier AI models on complex and policy-sensitive topics. You will evaluate AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback.

Responsibilities include applying evaluation rubrics for RLHF, SFT, and benchmarking; identifying unsafe outputs and policy violations; and collaborating with AI researchers and safety teams to drive