Remote Japanese Audio Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 62,000 - 83,000; Part time

Job summary

AI Trainer Jobs is seeking a Japanese Audio Recording Expert for a remote evaluation track. You will review prompts and responses against AuraOne's quality rubric, compare outputs, label edge cases, and provide structured feedback for retraining the modeling team.

This contractor role is remote, US-eligible, and paid hourly. You will judge voice agents and speech recognition, focusing on pronunciation and conversation quality, maintaining rubric-based tagging across long batches.

Qualifications

• Experience evaluating japanese generalist evaluation or adjacent content.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause.

Responsibilities

• Evaluate outputs against rubric and assign severity tags.
• Compare paired responses and select the stronger with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Calibrate reviewer scores against gold-standard examples weekly.

Skills

Evaluation experience

Attention to detail

Clear written reasoning

Inter-rater calibration

Async availability

Linguistics background (content)

Education

Linguistics background

Job description

AI Trainer Jobs is seeking a Japanese Audio Recording Expert for a remote evaluation track. You will review prompts and responses against AuraOne's quality rubric, compare outputs, label edge cases, and provide structured feedback for retraining the modeling team.

This contractor role is remote, US-eligible, and paid hourly. You will judge voice agents and speech recognition, focusing on pronunciation and conversation quality, maintaining rubric-based tagging across long batches.