AI Output Reviewer

SoTalent; Greater London; Remote; GBP 35,000 - 52,000; Full time

Benefits offered by this job

Remote-friendly

Job summary

Sotalent in London invites an AI Media Evaluation Specialist to review AI-generated content across voice, image, video and multimedia formats from a fully remote setup. You will perform structured evaluations, identify quality issues, and deliver evidence-based feedback to help shape future AI performance.

Ideal candidates have fluent English, sharp attention to detail, and the ability to work independently. Experience in content evaluation, annotation, or QA is a plus.

Qualifications

• Fluent English speaking and writing skills.
• Strong written communication and analytical abilities.
• Excellent attention to detail and observational skills.
• Ability to make objective evaluations and evidence-based decisions.
• Ability to work independently in a remote environment.

Responsibilities

• Engage in live, scenario-based conversations with AI voice models.
• Evaluate responses for clarity, usefulness, naturalness, accuracy, and flow.
• Compare AI-generated content across voice, image, video, and multimedia formats.
• Provide detailed written feedback and structured reports.
• Rate outputs across dimensions and deliver actionable improvement recommendations.
• Review captions, annotations, and labels for multimedia content.
• Participate in conversational testing with AI voice systems.

Skills

Fluent English

Strong written communication

Attention to detail

Independent / self-motivated

Remote work

Education

Bachelor's degree or equivalent

Job description

Location: London, England, United Kingdom

Industry: Software Development

Work Setting: Remote

Are you passionate about evaluating cutting-edge AI technologies, analyzing AI-generated media, and helping improve the next generation of intelligent systems through detailed feedback and quality assessment? We are seeking an AI Media Evaluation Specialist to review, compare, and assess AI-generated content across voice, image, video, and multimedia formats. In this flexible, remote role, you will play an important part in improving advanced AI models by providing structured evaluations, identifying quality issues, and delivering evidence-based feedback that helps shape future AI performance.

Key Responsibilities

• Engage in live, scenario-based conversations with AI voice models.
• Evaluate responses for clarity, usefulness, naturalness, accuracy, and conversational flow.
• Compare and rank AI-generated conversations based on overall quality and user experience.
• Identify issues related to pronunciation, pacing, tone, fluency, and comprehension.
• Provide detailed written feedback supporting evaluation decisions.

Image & Video Assessment

• Compare AI-generated images and videos against prompts and expected outcomes.
• Evaluate content for prompt adherence, realism, visual quality, creativity, and consistency.
• Identify artifacts and quality issues such as distorted anatomy, rendering errors, unrealistic details, text inaccuracies, and unnatural motion.
• Assess edited content against original versions to determine quality improvements.
• Support quality assurance efforts by documenting observations and recommendations.

Multimedia Quality Review

• Carefully inspect multimedia outputs using close observation techniques, including replaying and zooming when necessary.
• Detect inconsistencies between audio, video, and visual elements.
• Evaluate synchronization, realism, and overall content quality.
• Ensure assessments are objective, accurate, and aligned with evaluation guidelines.
• Maintain consistent standards across multiple content formats.
• Assess AI-generated speech for naturalness, clarity, pronunciation, and voice consistency.
• Evaluate how closely generated voices match target characteristics or intended scenarios.
• Identify speech artifacts, unnatural intonation, pacing issues, and audio quality concerns.
• Provide detailed analysis that supports ongoing voice model improvements.
• Contribute to enhancing conversational AI experiences.
• Review and improve AI-generated captions and annotations.
• Label activities, actions, and events within video content.
• Correct AI-generated descriptions to improve accuracy and clarity.
• Contribute to high-quality training datasets through annotation and validation activities.
• Ensure labels and captions accurately reflect observed actions and events.

Quality Assurance & Feedback

• Rate AI-generated outputs across dimensions such as adherence, realism, quality, and usability.
• Compare competing outputs and determine which best satisfies the prompt requirements.
• Write concise, evidence-based explanations supporting evaluation decisions.
• Identify recurring issues and trends across generated content.
• Deliver actionable feedback that contributes to model improvement.

Common Activities

• Compare multiple AI-generated images and determine the strongest result.
• Evaluate AI-generated videos against prompts and quality expectations.
• Review and improve captions and annotations for multimedia content.
• Participate in conversational testing with AI voice systems.
• Analyze audio outputs for speech quality and voice similarity.
• Provide rankings, ratings, and structured feedback reports.

Required Qualifications

• Fluent English speaking and writing skills.
• Strong written communication and analytical abilities.
• Excellent attention to detail and observational skills.
• Ability to make objective evaluations and evidence-based decisions.
• Ability to work independently in a remote environment.

Preferred Qualifications

• Bachelor's degree or equivalent educational experience.
• Experience in content moderation, quality assurance, evaluation, annotation, or review work.
• Experience writing structured reviews, evaluations, or feedback.
• Familiarity with AI technologies, digital media, or multimedia content analysis.
• Experience with image, video, audio, or speech evaluation tasks.