AI Policy & Safety Quality Auditor

Odixcity Consulting; La Réunion; Sur place; EUR 78 815 - 105 087; Plein temps

Résumé du poste

Odixcity Consulting is seeking an AI Policy Reviewer to evaluate both AI-generated and user content for compliance with internal governance and responsible AI principles. You will assess outputs for safety, bias, and policy alignment, serving as a crucial quality gate before deployment.

The role requires strong policy knowledge, clear written communication, and the ability to navigate complex edge cases with nuanced judgement. Remote, international scope.

Qualifications

• Minimum 3 years in Trust & Safety, policy, risk, or compliance.
• Deep understanding of content moderation and harmful content policies.
• Ability to deconstruct AI responses and identify biases.
• Strong written communication to explain AI missteps to engineers.
• Experience with dashboards and review tools; familiarity with LLMs.
• Resilience handling disturbing AI content.
• Attention to global cultural nuances.

Responsabilités

• Review AI and user content against policy rubrics.
• Act as QA checkpoint for automated systems.
• Handle edge cases with nuanced judgement.
• Identify systematic flaws and report biases.
• Collaborate with Policy to refine rubrics.
• Participate in red-teaming to test resilience.
• Explain ratings to ML engineers.
• Create prompts and golden examples for training.

Connaissances

Trust & Safety

Policy Analysis

Content Moderation

Communication Skills

LLM Familiarity

Outils

ChatGPT

Gemini

Description du poste

Odixcity Consulting is seeking an AI Policy Reviewer to evaluate both AI-generated and user content for compliance with internal governance and responsible AI principles. You will assess outputs for safety, bias, and policy alignment, serving as a crucial quality gate before deployment.

The role requires strong policy knowledge, clear written communication, and the ability to navigate complex edge cases with nuanced judgement. Remote, international scope.