Remote Swiss German Audio Evaluation Specialist

AI Trainer Jobs; United States; À distance; USD 28 000 - 55 000; Temps partiel

Résumé du poste

AI Trainer Jobs is seeking a Swiss German Audio transcription Expert for a remote evaluation track. Review prompts and responses against AuraOne's quality rubric, label edge cases, and provide structured feedback for retraining.

You will compare paired outputs, judge voice agents and speech, and ensure consistent multi-page rubric application. This independent contractor role offers hourly compensation after interviews with US eligibility.

Qualifications

• Experience with evaluation or annotation of German generalist evaluation or related content.
• Ability to apply multi-page rubrics consistently across large batches.
• Clear written reasoning that names the issue and rubric clause.
• Strong attention to detail and ability to flag prompt problems.
• Reliable async availability for at least 10 hours per week.

Responsabilités

• Evaluate german generalist evaluation outputs against a rubric and assign severity tags.
• Compare paired responses and provide rationale for the stronger answer.
• Label hallucinations, policy violations, and unsafe content with structured tags.
• Flag ambiguous prompts and route to program team for rubric updates.
• Calibrate reviewer scores against gold-standard examples weekly.

Connaissances

German generalist evaluation

Annotation

Inter-rater calibration

Rubric-based annotation

Severity tagging

Model output evaluation

Description du poste

AI Trainer Jobs is seeking a Swiss German Audio transcription Expert for a remote evaluation track. Review prompts and responses against AuraOne's quality rubric, label edge cases, and provide structured feedback for retraining.

You will compare paired outputs, judge voice agents and speech, and ensure consistent multi-page rubric application. This independent contractor role offers hourly compensation after interviews with US eligibility.