Remote Korean Music & Lyrics Evaluation Expert

AuraOne; United States; On-site; USD 48,000 - 85,000; Full time

Job summary

AuraOne is seeking a Music & Lyrics Expert - Korean to remotely review prompts and responses against the company's quality rubric. This evaluator role focuses on labeling, reasoning, and preparing structured feedback for model retraining.

The ideal candidate has prior Korean evaluation or annotation experience, can apply rubrics consistently across long batches, and provides clear written rationales. Remote contractors work asynchronously with US eligibility.

Qualifications

• Prior evaluation or annotation experience on Korean generalist evaluation.
• Clear written reasoning citing rubric clauses.
• Attention to detail and ability to flag problematic prompts.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate Korean generalist evaluation model outputs against a rubric and assign severity tags.
• Compare paired responses and provide rationale for stronger answer.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Document recurring failure modes for rubric updates.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Korean generalist evaluation

Job description

AuraOne is seeking a Music & Lyrics Expert - Korean to remotely review prompts and responses against the company's quality rubric. This evaluator role focuses on labeling, reasoning, and preparing structured feedback for model retraining.

The ideal candidate has prior Korean evaluation or annotation experience, can apply rubrics consistently across long batches, and provides clear written rationales. Remote contractors work asynchronously with US eligibility.