Remote Bilingual AI Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Full time

Job summary

AuraOne is seeking a Gã Bilingual Expert to remotely evaluate bilingual prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and write structured feedback to help retrain the model.

You will perform detailed assessments, tag issues with the rubric categories, and contribute to calibration efforts on a flexible contractor schedule. Strong written reasoning and attention to detail are essential.

Qualifications

• Prior evaluation, annotation, or human-rater experience on bilingual evaluation or adjacent content.

Responsibilities

• Evaluate bilingual evaluation model outputs against a versioned rubric and assign severity tags for Gã Bilingual Expert assignments.
• Compare paired responses and provide a written rationale for the stronger answer.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

Evaluation experience

Annotation

Human-rater experience

Job description

AuraOne is seeking a Gã Bilingual Expert to remotely evaluate bilingual prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and write structured feedback to help retrain the model.

You will perform detailed assessments, tag issues with the rubric categories, and contribute to calibration efforts on a flexible contractor schedule. Strong written reasoning and attention to detail are essential.