Remote Bhojpuri Language Evaluator & Rubric Auditor

AI Trainer Jobs; United States; Remote; USD 41,000 - 55,000; Full time

Benefits offered by this job

Remote work

Job summary

AI Trainer Jobs seeks a Bhojpuri Language Expert to remotely evaluate prompts and responses per AuraOne rubric. You will review paired outputs, label edge cases, and provide structured feedback for retraining the model.

As a remote contractor, you will turn evaluation outputs into auditable labels, rationales, and regression cases, ensuring high data quality for ongoing model improvements. Flexible schedule with US-eligible remote work and hourly compensation after interview.

Qualifications

• Prior evaluation or annotation experience on Bhojpuri language evaluation
• Ability to apply long rubrics consistently across batches
• Clear written reasoning naming issues and rubric clauses
• Reliable async availability for at least 10 hours per week

Responsibilities

• Evaluate Bhojpuri language outputs against a versioned rubric and assign severity tags.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples weekly.

Skills

Evaluation experience

Annotation experience

Linguistics background

Attention to detail

Async availability

Job description

AI Trainer Jobs seeks a Bhojpuri Language Expert to remotely evaluate prompts and responses per AuraOne rubric. You will review paired outputs, label edge cases, and provide structured feedback for retraining the model.

As a remote contractor, you will turn evaluation outputs into auditable labels, rationales, and regression cases, ensuring high data quality for ongoing model improvements. Flexible schedule with US-eligible remote work and hourly compensation after interview.