Remote Japanese Language QA Analyst & Rubric Reviewer

AuraOne Human Data

United States

Remote

USD 34,000 - 62,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne Human Data is seeking a Business Analyst (Japanese Language) for a remote evaluation track. You will review Japanese generalist evaluation prompts and responses, apply a versioned rubric, and provide structured feedback to retrain models.

As a remote contractor, you will compare outputs, label edge cases with severity tags, and document recurring failure modes to help the modeling team improve quality assurance processes. Strong written reasoning and Japanese proficiency are essential.

Qualifications

  • Experience evaluating, annotating, or rater work on evaluation prompts (Japanese) is required.
  • Clear written reasoning that names the issue and rubric clause applied.
  • Reliable async availability for at least 10 hours per week.

Responsibilities

  • Evaluate Japanese generalist evaluation model outputs against a rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Document recurring failure modes and provide feedback for rubric updates.

Skills

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Japanese generalist evaluation
Critical Thinking
Business Analysis

Job description

AuraOne Human Data is seeking a Business Analyst (Japanese Language) for a remote evaluation track. You will review Japanese generalist evaluation prompts and responses, apply a versioned rubric, and provide structured feedback to retrain models.

As a remote contractor, you will compare outputs, label edge cases with severity tags, and document recurring failure modes to help the modeling team improve quality assurance processes. Strong written reasoning and Japanese proficiency are essential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Japanese Evaluation Specialist — Contractor
Remote Japanese Evaluation Specialist — Contractor

AuraOne Human Data • United States

Remote
USD 57,000 - 81,000
Business Analyst (Japanese Language)
Business Analyst (Japanese Language)

AuraOne Human Data • United States

Remote
USD 34,000 - 62,000
Remote: Japanese AI Evaluation & Feedback Specialist
Remote: Japanese AI Evaluation & Feedback Specialist

Auraone • United States

Remote
USD 58,000 - 80,000
Remote AI Response Reviewer - Japanese Business Documents
Remote AI Response Reviewer - Japanese Business Documents

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Remote Japanese AI Evaluation Specialist
Remote Japanese AI Evaluation Specialist

AuraOne, Inc. • United States

Remote
USD 34,000 - 49,000
Remote Japanese AI Evaluation Specialist — Contractor
Remote Japanese AI Evaluation Specialist — Contractor

AuraOne Human Data • United States

Remote
USD 34,000 - 49,000
Remote Japanese Annotator & Transcription QA Specialist
Remote Japanese Annotator & Transcription QA Specialist

Auraone • United States

Remote
USD 28,000 - 47,000
Remote Japanese Annotation Evaluator & Rubric Trainer
Remote Japanese Annotation Evaluator & Rubric Trainer

AuraOne Human Data • United States

Remote
USD 28,000 - 55,000
Remote Japanese Marketing Evaluation Specialist
Remote Japanese Marketing Evaluation Specialist

Auraone • United States

Remote
USD 34,000 - 55,000
Remote Bilingual Japanese Psychologist (PhD) — Evaluator
Remote Bilingual Japanese Psychologist (PhD) — Evaluator

Auraone • United States

Remote
USD 55,000 - 83,000