Remote Hindi Evaluation Specialist - Model QA & Feedback

AI Trainer Jobs; United States; Remote; USD 34,000 - 62,000; Full time

Job summary

AI Trainer Jobs is seeking a Hindi Transcription Expert for a remote evaluation track. You will review Hindi prompts and responses, compare outputs, label edge cases, and provide structured feedback to aid retraining.

This role is a contractor, remote and US-eligible, with hourly compensation after interview. Responsibilities include evaluating model outputs against a rubric, tagging severities, and documenting issues to support ongoing improvement of the AuraOne data pipeline.

Qualifications

• Prior evaluation, annotation, or human-rater experience on Hindi content.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and rubric clause.
• Strong attention to detail and ability to flag prompt problems.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate Hindi generalist evaluation model outputs against a rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route to program team for rubric updates.
• Maintain reviewer quality against gold-standard examples weekly.

Skills

Hindi proficiency

Annotation experience

Multi-page rubrics

Strong written reasoning

Async availability

Job description

AI Trainer Jobs is seeking a Hindi Transcription Expert for a remote evaluation track. You will review Hindi prompts and responses, compare outputs, label edge cases, and provide structured feedback to aid retraining.

This role is a contractor, remote and US-eligible, with hourly compensation after interview. Responsibilities include evaluating model outputs against a rubric, tagging severities, and documenting issues to support ongoing improvement of the AuraOne data pipeline.