Korean AI Evaluation Specialist - Remote Contractor

AuraOne Human Data

United States

Remote

USD 39.000 - 47.000

Vollzeit

Vor 2 Tagen
Sei unter den ersten Bewerbenden

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

AuraOne, Inc. is seeking a Korean AI Evaluation Specialist to remotely review Korean generalist evaluation prompts and responses against AuraOne's quality rubric. You will label edge cases and produce structured feedback to retrain models, ensuring auditable outputs for the data team.

You will compare paired responses, pick the stronger answer with rationale, and tag unsafe content or policy violations. The role requires sharp attention to detail and async availability of at least 10 hours per

Qualifikationen

  • Prior evaluation, annotation, or human-rater experience in Korean evaluation work.
  • Ability to apply multi-page rubrics consistently across long batches.
  • Clear written reasoning naming the issue and rubric clause applied.

Aufgaben

  • Evaluate Korean generalist evaluation model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them for rubric updates.

Kenntnisse

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Korean generalist evaluation
AI model evaluation

Jobbeschreibung

AuraOne, Inc. is seeking a Korean AI Evaluation Specialist to remotely review Korean generalist evaluation prompts and responses against AuraOne's quality rubric. You will label edge cases and produce structured feedback to retrain models, ensuring auditable outputs for the data team.

You will compare paired responses, pick the stronger answer with rationale, and tag unsafe content or policy violations. The role requires sharp attention to detail and async availability of at least 10 hours per

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Korean AI Evaluation Specialist — Remote
Korean AI Evaluation Specialist — Remote

AuraOne Human Data • USA

Remote
USD 30.000 - 55.000
Remote work
Contractor role
US-eligible
Remote AI Quality Analyst - Korean Personalization Contractor
Remote AI Quality Analyst - Korean Personalization Contractor

AuraOne Human Data • USA

Remote
USD 17.000 - 24.000
Remote Korean Language Evaluation Specialist (AI Quality)
Remote Korean Language Evaluation Specialist (AI Quality)

Auraone • USA

Remote
USD 34.000 - 55.000
Remote AI Evaluation & Labeling Specialist
Remote AI Evaluation & Labeling Specialist

AuraOne Human Data • USA

Remote
USD 34.000 - 62.000
Korean AI Evaluation Specialist (South Korea)
Korean AI Evaluation Specialist (South Korea)

AuraOne Human Data • USA

Remote
USD 39.000 - 47.000
Korean ChatGPT Evaluation Specialist — Remote Contractor
Korean ChatGPT Evaluation Specialist — Remote Contractor

Auraone • USA

Remote
USD 58.000 - 80.000
AI Quality Analyst (Personalization) - Korean
AI Quality Analyst (Personalization) - Korean

AuraOne Human Data • USA

Remote
USD 17.000 - 24.000
Korean Evaluation Specialist (Remote) - Data Labeling
Korean Evaluation Specialist (Remote) - Data Labeling

Auraone • USA

Remote
USD 20.000 - 29.000
Korean-Speaking Generalist — Remote AI Evaluation
Korean-Speaking Generalist — Remote AI Evaluation

AuraOne Human Data • USA

Remote
USD 30.000 - 55.000
Remote work
Contractor role
US-eligible
Remote AI Response Reviewer — Korean Business Docs
Remote AI Response Reviewer — Korean Business Docs

AuraOne Human Data • USA

Remote
USD 34.000 - 55.000