Remote Hindi Transcription Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 28,000 - 55,000; Part time

Job summary

AI Trainer Jobs seeks a Romanized Hindi Transcription Expert to remotely evaluate Hindi generalist prompts and responses against a quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for model retraining.

You will assess model outputs, tag issues, and contribute to calibration cycles as a contractor working on a remote program with US eligibility.

Qualifications

• Experience in evaluating Hindi generalist outputs or related content.
• Clear written reasoning that names the issue and the rubric clause being applied.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate Hindi generalist evaluation model outputs against a rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route to program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples.

Skills

Hindi transcription

Rubric-based tagging

Inter-rater calibration

Quality evaluation

Job description

AI Trainer Jobs seeks a Romanized Hindi Transcription Expert to remotely evaluate Hindi generalist prompts and responses against a quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for model retraining.

You will assess model outputs, tag issues, and contribute to calibration cycles as a contractor working on a remote program with US eligibility.