Korean PDF Annotation & Evaluation Specialist (Remote)

AuraOne, Inc.; United States; Remote; USD 39.000 - 55.000; Teilzeit

Benefits dieser Stelle

Remote work

Contractor role

Zusammenfassung

AuraOne, Inc. is seeking a remote Korean specialist to evaluate model outputs for fluency, tone, and cultural accuracy. You will compare paired Korean responses, justify the stronger choice, and tag issues with detailed rationales to guide future training cycles.

This is a contractor role with US eligibility, requiring native or near-native Korean and strong written English. Expected commitment is at least 10 hours per week, with async work supported.

Qualifikationen

• Native or near-native Korean fluency with strong written-English ability for PDF Annotation & Transcription Experts - Korean work.
• Demonstrable experience editing, translating, or evaluating Korean content.
• Comfort applying multi-page rubrics consistently across long evaluation batches.
• Clear written reasoning that names the issue and the standard being applied.
• Reliable async availability for at least 10 hours per week.

Aufgaben

• Evaluate Korean model responses for fluency, accuracy, register, and cultural fit for assignments.
• Compare paired Korean annotation outputs and pick the stronger response with a written rationale.
• Flag hallucinations, code-switching errors, and formality mismatches with task-specific severity tags.
• Capture native-speaker edits that demonstrate the correct phrasing alongside each issue.
• Calibrate against the AuraOne Korean rubric in weekly reviewer-quality cycles.
• Surface ambiguous prompts back to the program team so the rubric can be sharpened.
• Maintain reviewer notes that document tricky idioms, regionalisms, and emerging usage.

Kenntnisse

Korean annotation

Native-speaker review

Multilingual evaluation

LLM output evaluation

Rubric application

Written English ability

English proficiency

Tools

TMS tools

MQM error taxonomies

Jobbeschreibung

AuraOne, Inc. is seeking a remote Korean specialist to evaluate model outputs for fluency, tone, and cultural accuracy. You will compare paired Korean responses, justify the stronger choice, and tag issues with detailed rationales to guide future training cycles.

This is a contractor role with US eligibility, requiring native or near-native Korean and strong written English. Expected commitment is at least 10 hours per week, with async work supported.