Remote Japanese HR Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Full time

Job summary

AuraOne is seeking a remote HR Documents Specialist (Japanese) to review prompts and responses against our quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for retraining the model.

The role is a contractor position with hourly compensation, remote from the US, requiring strong attention to detail, prior evaluation experience, and clear written reasoning. Availability of at least 10 hours per week is preferred.

Qualifications

• Experience evaluating Japanese generalist prompts and responses.
• Ability to apply rubrics consistently across batches.
• Strong written reasoning and edge-case labeling.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and justify selection with rationale.
• Label hallucinations, instruction-following failures, and unsafe content.
• Capture ambiguous prompts and route for rubric updates.
• Maintain reviewer-quality scores through calibration with gold-standard examples.

Skills

Japanese evaluation

Inter-rater calibration

Rubric-based annotation

Tools

Annotation tools

Job description

AuraOne is seeking a remote HR Documents Specialist (Japanese) to review prompts and responses against our quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for retraining the model.

The role is a contractor position with hourly compensation, remote from the US, requiring strong attention to detail, prior evaluation experience, and clear written reasoning. Availability of at least 10 hours per week is preferred.