Remote Korean Bilingual Evaluation Specialist

Auraone

United States

Remote

USD 34,000 - 55,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AI Trainer Jobs is seeking a Korean bilingual expert for a remote evaluation track. The role involves reviewing Korean generalist prompts and responses against AuraOne's rubric, comparing paired outputs, and writing structured feedback for retraining.

As a remote independent contractor, you will assess outputs, tag issues, and calibrate ratings weekly. The position offers an hourly rate to be confirmed after the interview, with eligibility to work from the United States.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on Korean generalist evaluation.
  • Clear written reasoning that names the issue and the rubric clause applied.
  • Strong attention to detail and ability to flag prompts that are problematic.

Responsibilities

  • Evaluate Korean generalist evaluation model outputs against a rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them for rubric updates.
  • Maintain reviewer quality scores by calibration against gold-standard examples.

Skills

Korean language
Annotation
Quality evaluation
Inter-rater calibration

Job description

AI Trainer Jobs is seeking a Korean bilingual expert for a remote evaluation track. The role involves reviewing Korean generalist prompts and responses against AuraOne's rubric, comparing paired outputs, and writing structured feedback for retraining.

As a remote independent contractor, you will assess outputs, tag issues, and calibrate ratings weekly. The position offers an hourly rate to be confirmed after the interview, with eligibility to work from the United States.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Korean Language Evaluation Specialist (AI Quality)
Remote Korean Language Evaluation Specialist (AI Quality)

Auraone • United States

Remote
USD 34,000 - 55,000
Korean Evaluation Specialist (Remote) - Data Labeling
Korean Evaluation Specialist (Remote) - Data Labeling

Auraone • United States

Remote
USD 20,000 - 29,000
Korean-Speaking Generalist — Remote AI Evaluation
Korean-Speaking Generalist — Remote AI Evaluation

AuraOne Human Data • United States

Remote
USD 30,000 - 55,000
Remote work
Contractor role
US-eligible
Korean AI Evaluation Specialist — Remote
Korean AI Evaluation Specialist — Remote

AuraOne Human Data • United States

Remote
USD 30,000 - 55,000
Remote work
Contractor role
US-eligible
Korean Linguistic Evaluator & Rubric QA (Remote)
Korean Linguistic Evaluator & Rubric QA (Remote)

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Korean ChatGPT Evaluation Specialist — Remote Contractor
Korean ChatGPT Evaluation Specialist — Remote Contractor

Auraone • United States

Remote
USD 58,000 - 80,000
Remote AI Korean Evaluator & Trainer
Remote AI Korean Evaluator & Trainer

prolificacademicltd • United States

Remote
USD 34,000 - 69,000
Remote work
Flexible schedule
Task-based pay
+1
Remote AI Korean Trainer — Expert Language Evaluator
Remote AI Korean Trainer — Expert Language Evaluator

prolificacademicltd • United States

Remote
USD 34,000 - 83,000
Fully remote
Task-based compensation
Flexible hours
Korean Linguistic Expert
Korean Linguistic Expert

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote Romanian Bilingual Evaluation Specialist
Remote Romanian Bilingual Evaluation Specialist

Auraone • United States

Remote
USD 28,000 - 55,000
Remote work
Independent contractor
Hourly rate after interview