Frontier AI Safety Evaluator & Alignment Expert

Mercor; Wien; Vor Ort; EUR 70.000 - 100.000; Vollzeit

Zusammenfassung

Obsidian seeks experienced AI Safety Practitioners to evaluate frontier model safety, quality, and alignment across complex, policy-sensitive topics. You will assess AI outputs and help improve model behavior through structured evaluations.

Join a team of researchers and safety engineers in Vienna to shape responsible AI with rigorous rubrics and actionable feedback across RLHF, SFT, and safety benchmarking.

Qualifikationen

• 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.
• Excellent written English, critical thinking, and analytical reasoning skills.
• Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Aufgaben

• Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
• Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
• Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
• Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
• Provide structured feedback to improve model alignment and safety performance.
• Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Kenntnisse

Experience in AI safety

Excellent written English

Critical thinking

Policy-sensitive evaluation

Ausbildung

Bachelor's degree or higher in a related field

Jobbeschreibung

Obsidian seeks experienced AI Safety Practitioners to evaluate frontier model safety, quality, and alignment across complex, policy-sensitive topics. You will assess AI outputs and help improve model behavior through structured evaluations.

Join a team of researchers and safety engineers in Vienna to shape responsible AI with rigorous rubrics and actionable feedback across RLHF, SFT, and safety benchmarking.