Remote Hindi Evaluation Specialist (Contractor)

AuraOne, Inc.; United States; Remote; USD 41,000 - 207,000; Full time

Job summary

AuraOne, Inc. is seeking a remote evaluation contractor to review Hindi generalist outputs against our quality rubric. You will label edge cases, assign severity, and provide structured feedback to retrain models.

As a CONTRACTOR, you will compare paired responses, write rationales, and maintain calibration scores weekly. This role suits detail-oriented evaluators with experience in Hindi content review and a reliable remote schedule.

Qualifications

• Prior evaluation/annotation experience on hindi generalist evaluation.
• Comfort applying multi-page rubrics across long batches.
• Clear written reasoning naming the issue and rubric clause.
• Strong attention to detail and ability to flag prompt issues.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate hindi generalist evaluation model outputs against a versioned rubric.
• Compare paired responses and provide written rationale.
• Label unsafe content with structured tags.
• Capture ambiguous prompts and route for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples.
• Document recurring failure modes for retraining.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Hindi generalist evaluation

Job description

AuraOne, Inc. is seeking a remote evaluation contractor to review Hindi generalist outputs against our quality rubric. You will label edge cases, assign severity, and provide structured feedback to retrain models.

As a CONTRACTOR, you will compare paired responses, write rationales, and maintain calibration scores weekly. This role suits detail-oriented evaluators with experience in Hindi content review and a reliable remote schedule.