Remote Hindi Evaluation Specialist

AuraOne; United States; On-site; USD 15,000 - 21,000; Full time

Benefits offered by this job

Remote work

Job summary

AuraOne is seeking a Remote Bilingual Writer - Hindi (India) to evaluate hindi generalist outputs, apply rubrics, and produce structured feedback for retraining. You will compare responses, label issues, and help refine prompts and rubrics, working as an independent contractor with flexible weekly hours.

Ideal candidates have prior Hindi evaluation experience, strong reasoning, and meticulous attention to detail, with at least 10 hours per week available.

Qualifications

• Experience evaluating hindi generalist content or similar work.
• Ability to apply multi-page rubrics consistently on long batches.
• Clear written reasoning naming issues and rubric clauses.
• Strong attention to detail and ability to flag prompt problems.
• Available asynchronously for at least 10 hours per week.

Responsibilities

• Evaluate hindi outputs against rubric and assign severity tags.
• Compare paired responses and select the stronger with rationale.
• Label hallucinations, instruction-following failures, and unsafe content.
• Capture ambiguous prompts and route to rubric updates.
• Calibrate reviewer scores against gold-standard examples weekly.
• Document recurring failure modes for model training.

Skills

Model eval

Rubric annotation

Severity tags

Rater calibration

Hindi eval

Job description

AuraOne is seeking a Remote Bilingual Writer - Hindi (India) to evaluate hindi generalist outputs, apply rubrics, and produce structured feedback for retraining. You will compare responses, label issues, and help refine prompts and rubrics, working as an independent contractor with flexible weekly hours.

Ideal candidates have prior Hindi evaluation experience, strong reasoning, and meticulous attention to detail, with at least 10 hours per week available.