Senior AI Evaluation & RLHF Specialist

Innodata Inc.; Philippines; On-site; PHP 300,000 - 540,000; Full time

Job summary

Innodata Inc. in the Philippines is seeking a detail-oriented AI data annotator to evaluate model outputs and provide actionable feedback to improve RLHF processes.

You will work on complex AI tasks requiring critical thinking and careful content evaluation, contributing to high-quality data labeling and model assessment.

2+ years of experience in AI data annotation or related fields are preferred, with strong analytical skills and a proactive quality mindset.

Qualifications

• 2+ years of experience in AI data annotation, evaluation, content quality, or related fields.
• Strong analytical and critical thinking skills.
• Experience with AI/LLM projects, data labeling, or model evaluation is preferred.

Responsibilities

• Evaluate model outputs and provide detailed feedback to improve RLHF.
• Contribute to high-quality data labeling and model evaluation.
• Work on complex AI tasks requiring critical thinking and content evaluation.

Skills

AI data annotation

Analytical thinking

AI/LLM project experience

Job description

Contribute to cutting-edge AI development by evaluating model outputs and providing detailed feedback to improve performance through Reinforcement Learning from Human Feedback (RLHF). You will work on complex AI tasks requiring critical thinking, reasoning, and content evaluation.

Requirements:

• 2+ years of experience in AI data annotation, evaluation, content quality, or related fields
• Strong analytical and critical thinking skills
• Experience with AI/LLM projects, data labeling, or model evaluation is preferred