Remote German Music Audio Quality Reviewer

AuraOne; United States; Remote; USD 44,000 - 80,000; Part time

Job summary

AI Trainer Jobs seeks a Music Audio Expert - German for remote evaluation work. You will review German generalist evaluation prompts and responses, assess against a versioned rubric, and write structured feedback to retrain the model.

You will judge voice agents and pronunciation quality, label edge cases, and maintain calibration with gold standards through weekly reviews. Contract-based, part-time hours expected.

Qualifications

• Prior evaluation or annotation experience on German generalist evaluation tasks.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and the rubric clause being applied.

Responsibilities

• Evaluate German evaluation model outputs against a rubric and assign severity tags.
• Compare paired responses and select the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Calibrate reviewer scores against gold-standard examples weekly.

Skills

German evaluation

Annotation

Inter-rater calibration

Linguistics background

Tools

Rubrics

Inter-rater metrics

Job description

AI Trainer Jobs seeks a Music Audio Expert - German for remote evaluation work. You will review German generalist evaluation prompts and responses, assess against a versioned rubric, and write structured feedback to retrain the model.

You will judge voice agents and pronunciation quality, label edge cases, and maintain calibration with gold standards through weekly reviews. Contract-based, part-time hours expected.