A.I Content Reviewer

Odixcity Consulting; La Réunion; Remote; EUR 54,000 - 80,000; Full time

Job summary

Odixcity Consulting seeks an AI Content Reviewer to evaluate AI-generated content across platforms, ensuring accuracy, clarity, and brand alignment with safety guidelines.

You will label training data, audit reviewers, and collaborate with operations to refine annotation instructions, while applying rigorous quality standards in a fast-paced setting.

Qualifications

• Minimum of 2 years of professional experience in Content Review, Moderation, Fact-Checking, or Quality Assurance within the tech or digital media space.
• Ability to analyze complex information quickly and justify decisions based on ambiguous guidelines.
• Comfortable working with multiple software platforms, spreadsheets, and internal annotation tools.
• Ability to handle exposure to potentially sensitive content with professionalism and emotional intelligence.
• Experience working with Generative AI models (ChatGPT, Bard, Midjourney) from a testing or feedback perspective.
• Background in Linguistics, data annotation, or computational Linguistics.
• Ability to work in a fast-paced, ambiguous environment where guidelines and product features evolve frequently.
• Ability to review AI-generated content for factual accuracy and regulatory compliance is highly desirable.

Responsibilities

• Review AI-generated text, image descriptions, or code for accuracy, relevance, toxicity, and bias.
• Create high-quality training datasets by labeling data according to strict guidelines.
• Audit the work of junior reviewers or automated systems to ensure consistency and adherence to project rubrics.
• Collaborate with operations teams to refine style guides and annotation instructions based on trends and edge cases.
• Identify patterns in model errors and provide detailed feedback to data scientists and engineers for model improvement.
• Familiarity with basic metrics like Inter-Agreement Rates of F1 scores and understand how reviews impact statistics.

Skills

Content review

Moderation

Analytical thinking

Linguistics background

AI model feedback

Data annotation

Education

Linguistics / Computational Linguistics background

Job description

Job Title: AI Content Reviewer

Location: Remote (Worldwide)

Job Summary

We are seeking a meticulous and analytical AI Content Reviewer to evaluate and enhance AI-generated content across various platforms. In this role, you will review outputs produced by AI systems to ensure accuracy, clarity, factual integrity, brand alignment, and compliance with safety and ethical guidelines.

Responsibilities

• Review AI-generated text, image descriptions, or code for accuracy, relevance, toxicity, and bias.
• Create high-quality training datasets by labeling data according to strict guidelines.
• Audit the work of junior reviewers or automated systems to ensure consistency and adherence to project rubrics.
• Collaborate with the operations teams to refine style guides and annotation instructions based on emerging trends and edge cases.
• Identify patterns in model errors and provide detailed feedback to data scientists and engineers for model improvement.
• Familiarity with basic metrics like Inter-Agreement Rates of F1 scores. Understanding how your reviews impact model performance statistics is key.

Requirements

• Minimum of 2 years of professional experience in Content Review, Moderation, Fact-Checking, or Quality Assurance within the tech or digital media space.
• Proven ability to analyze complex information quickly, make reasoned judgements, and justify decisions based on ambiguous guidelines.
• Comfortable working with multiple software platforms, spreadsheets, and internal annotation tools simultaneously.
• Ability to handle exposure to potentially sensitive or disturbing content with professionalism and emotional intelligence.
• Experience working with Generative AI models (ChatGPT, Bard, Midjourney, etc.) from a testing or feedback perspective.
• Background in Linguistics, data annotation, or computational Linguistics.
• Ability to work in a fast-paced, ambiguous environment where guidelines and product features evolve frequently.
• Ability to review AI-generated content for factual accuracy and regulatory compliance within a high-stakes domain is highly desirable.