Marathi Audio Evaluation Specialist (Remote)

AI Trainer Jobs; United States; Remote; USD 59,000 - 79,000; Full time

Job summary

AI Trainer Jobs seeks a Marathi Audio transcription Expert to remotely evaluate audio annotation outputs against AuraOne's rubric. Review prompts, assess edge cases, and provide structured feedback for model retraining.

Role involves comparing paired outputs, labeling issues, and contributing to calibration cycles with strong attention to detail and clear rationale. Independent contractor with US-eligible remote work, hourly compensation after interview.

Qualifications

• Experience evaluating audio annotation or related content.
• Strong ability to apply rubrics consistently to Marathi audio content.
• Clear written reasoning naming issues and rubric clauses.

Responsibilities

• Evaluate audio annotation model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Audio annotation

Job description

AI Trainer Jobs seeks a Marathi Audio transcription Expert to remotely evaluate audio annotation outputs against AuraOne's rubric. Review prompts, assess edge cases, and provide structured feedback for model retraining.

Role involves comparing paired outputs, labeling issues, and contributing to calibration cycles with strong attention to detail and clear rationale. Independent contractor with US-eligible remote work, hourly compensation after interview.