Remote Voice Recorder (German/English) – AI Evaluation

AuraOne; United States; Remote; USD 34,000 - 69,000; Part time

Job summary

AI Trainer Jobs is seeking a remote Voice Recorder reviewer for German and English evaluation work. You will assess model outputs against rubrics, label issues, and provide structured feedback to retrain and improve prompts.

The role requires strong attention to detail, the ability to apply rubrics consistently, and reliable async availability for at least 10 hours weekly. Compensation is hourly and determined after interview.

Qualifications

• Experience in evaluation/annotation or human-rater roles for Voice Recorder (German + English).
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning naming issues and rubric clauses.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate german generalist evaluation model outputs against a versioned rubric and assign severity tags for Voice Recorder (German + English) assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

German language

English language

Attention to detail

Async availability

Inter-rater calibration

Job description

AI Trainer Jobs is seeking a remote Voice Recorder reviewer for German and English evaluation work. You will assess model outputs against rubrics, label issues, and provide structured feedback to retrain and improve prompts.

The role requires strong attention to detail, the ability to apply rubrics consistently, and reliable async availability for at least 10 hours weekly. Compensation is hourly and determined after interview.