Korean Music Audio QA Specialist (Remote, Contractor)

AuraOne; United States; Remote; USD 48,000 - 85,000; Part time

Job summary

AuraOne is seeking a Music Audio Expert - Korean for a remote evaluation track. You will review Korean generalist evaluation prompts and responses, compare paired outputs, and provide structured feedback for retraining.

As a contractor, you will label issues, assign severity tags, and capture edge cases to help improve AuraOne's quality rubric. You will maintain consistency across long batches with clear, rational explanations.

Qualifications

• Experience evaluating Korean generalist outputs or adjacent content.
• Ability to apply rubrics consistently to long batches.
• Clear written reasoning naming the issue and rubric clause.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and provide rationale for the stronger answer.
• Label hallucinations, instruction-following failures, and unsafe content.
• Capture ambiguous prompts and route to program team.
• Calibrate reviewer quality against gold-standard examples weekly.

Skills

Korean evaluation experience

Annotation experience

Job description

AuraOne is seeking a Music Audio Expert - Korean for a remote evaluation track. You will review Korean generalist evaluation prompts and responses, compare paired outputs, and provide structured feedback for retraining.

As a contractor, you will label issues, assign severity tags, and capture edge cases to help improve AuraOne's quality rubric. You will maintain consistency across long batches with clear, rational explanations.