Remote Hebrew Music & Lyrics Evaluator

AI Trainer Jobs; United States; Remote; USD 23,000 - 58,000; Part time

Job summary

AuraOne is seeking a Music & Lyrics Expert - Hebrew to remotely review Hebrew prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and write structured feedback for model retraining.

As a remote contractor, you’ll review frontier model outputs, tag inaccuracies, and calibrate other evaluators. Strong written reasoning and Hebrew language skills are essential for consistent rubric application.

Qualifications

• Prior evaluation, annotation, or human-rater experience on Hebrew generalist evaluation or adjacent content for Music & Lyrics Expert - Hebrew work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and the rubric clause being applied.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate Hebrew generalist evaluation model outputs against a versioned rubric and assign severity tags for Music & Lyrics Expert - Hebrew assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Job description

AuraOne is seeking a Music & Lyrics Expert - Hebrew to remotely review Hebrew prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and write structured feedback for model retraining.

As a remote contractor, you’ll review frontier model outputs, tag inaccuracies, and calibrate other evaluators. Strong written reasoning and Hebrew language skills are essential for consistent rubric application.