Remote Hindi Evaluation Specialist & Model Feedback

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Part time

Job summary

AuraOne is seeking a Hindi Language Expert (US/Canada Based) to remotely review Hindi prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and write structured feedback for retraining.

As a contractor, you’ll evaluate frontier model outputs, judge benchmark failures, and calibrate fellow reviewers. Must have experience in Hindi evaluation or related content, with strong written reasoning and attention to detail.

Qualifications

• Experience evaluating Hindi generalist evaluation or related content.
• Clear written reasoning that names issues and rubric clauses.
• Ability to flag problematic prompts accurately.

Responsibilities

• Evaluate Hindi generalist outputs against a versioned rubric.
• Label edge cases with structured tags.
• Compare paired responses and select the stronger answer with rationale.
• Capture ambiguous prompts and route to rubric updates.
• Calibrate reviewer quality against gold-standard examples.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Hindi generalist evaluation

Job description

AuraOne is seeking a Hindi Language Expert (US/Canada Based) to remotely review Hindi prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and write structured feedback for retraining.

As a contractor, you’ll evaluate frontier model outputs, judge benchmark failures, and calibrate fellow reviewers. Must have experience in Hindi evaluation or related content, with strong written reasoning and attention to detail.