Video and Audio Evaluator

Innodata Knowledge Services, Inc.; Manila; On-site; PHP 223,000 - 446,000; Full time

Benefits offered by this job

Flexible schedule

Job summary

Innodata Knowledge Services, Inc. is seeking detail-oriented freelancers to support LLM training by reviewing, annotating, and evaluating multimedia content. You will analyze video and audio data, identify key elements, and provide high-quality annotations to improve AI models.

The role emphasizes following project guidelines, maintaining consistency, and delivering accurate descriptions with strong English communication and observational skills.

Qualifications

• Bachelor's degree required or equivalent.
• Excellent English communication, reading, and comprehension skills.
• Strong attention to detail and observational ability.
• Ability to interpret visual and audio information accurately.
• Comfortable following structured guidelines and quality standards.
• Reliable internet connection and access to a personal laptop.

Responsibilities

• Review and annotate video and audio content according to project guidelines.
• Evaluate the accuracy, completeness, and quality of AI-generated descriptions for multimedia content.
• Compare multiple AI-generated responses and determine the most accurate and contextually appropriate output.
• Identify key visual and audio elements, including objects, people, actions, events, environments, emotions, sounds, and contextual details.
• Assess descriptive accuracy, relevance, consistency, and completeness of annotations.
• Label and categorize multimedia content using designated annotation tools.
• Provide objective feedback to improve AI-generated outputs.
• Follow annotation guidelines and quality standards while maintaining consistency across tasks.

Skills

English proficiency

Attention to detail

Observational skills

Visual/audio interpretation

Structured guidelines

Reliable internet

Education

Bachelor's degree

Job description

About the role

We are seeking detail-oriented and analytical freelancers to support the training and evaluation of Large Language Models (LLMs) by reviewing, annotating, and evaluating video and audio content. In this role, you will analyze multimedia data, assess descriptive details, and provide high-quality annotations that help improve AI models' understanding of visual and audio information.

Key responsibilities

• Review and annotate video and audio content according to project guidelines.
• Evaluate the accuracy, completeness, and quality of AI-generated descriptions for multimedia content.
• Compare multiple AI-generated responses and determine the most accurate and contextually appropriate output.
• Identify key visual and audio elements, including objects, people, actions, events, environments, emotions, sounds, and contextual details.
• Assess descriptive accuracy, relevance, consistency, and completeness of annotations.
• Label and categorize multimedia content using designated annotation tools.
• Provide objective feedback to improve AI-generated outputs.
• Follow annotation guidelines and quality standards while maintaining consistency across tasks.

About you

• Bachelor's degree in any course
• Excellent English communication, reading, and comprehension skills.
• Excellent attention to detail and observational skills.
• Ability to interpret visual and audio information accurately.
• Comfortable working with structured guidelines and quality standards.
• Reliable internet connection and personal computer laptop.

Benefits

• Flexible schedule