Content Evaluator

Innodata India; India; Remote; INR 400,000 - 700,000; Full time

Job summary

Innodata India is seeking AI Data Annotation & Evaluation Specialists to support AI/LLM and multimodal projects. The role involves text evaluation, prompt/response review, image/video annotation, and audio-visual analysis across varied tasks.

You will create annotations and evaluation rationales, identify errors, and ensure adherence to guidelines. The role emphasizes accuracy, attention to detail, and meeting quality and productivity targets.

Qualifications

• Minimum Bachelor’s degree in any discipline.
• Strong English proficiency, written and spoken.
• Excellent analytical skills and attention to detail.

Responsibilities

• Review and annotate text, prompts, and AI-generated content per guidelines.
• Evaluate image/video content including annotations and OCR where required.
• Perform audio-visual reviews and transcripts alignment as needed.
• Identify and correct errors in annotated data to improve model quality.
• Maintain accuracy, consistency, and adherence to project guidelines.
• Meet defined quality, productivity, and production-hour targets.

Skills

English proficiency

Analytical thinking

Attention to detail

Education

Bachelor's degree

Job description

Role Overview: We are looking for AI Data Annotation & Evaluation Specialists to support a variety of AI/LLM and multimodal AI projects. The role will be dynamic, and responsibilities may vary based on project requirements, including text/content evaluation, prompt and response review, image/video annotation, audio-visual analysis, and AI model evaluation.

Key Responsibilities

• Review, annotate, evaluate, and validate text, prompts, AI-generated responses, images, videos, and audio-visual content as per project guidelines.
• Assess content for accuracy, relevance, quality, consistency, safety, and contextual alignment.
• Perform video and visual annotation activities such as video relevancy review, action/event identification, tracking, bounding box annotation, OCR, and temporal analysis, as applicable.
• Review audio-visual content, including transcripts, speech-action alignment, sound identification, and related evaluations.
• Create prompts, event descriptions, annotations, and professional evaluation rationales to support AI model training and improvement.
• Identify and correct errors, inconsistencies, or quality issues in annotated and AIgenerated data.
• Maintain high standards of accuracy, attention to detail, consistency, and guideline adherence.
• Meet defined quality, productivity, AHT, and production-hour targets.

Eligibility

• Minimum Bachelors degree in any discipline.
• Strong English proficiency, both written and spoken.
• Excellent analytical skills and attention to detail.
• Ability to work across different types of AI annotation and evaluation tasks based on business/project requirements.
• Prior experience in Data Annotation, Content Review, Image/Video Annotation, AI/LLM Evaluation, or similar roles will be an added advantage