Remote French Language Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Part time

Job summary

AuraOne is seeking a French Language Expert for a remote evaluation track to review French generalist prompts and responses against our quality rubric. Review paired outputs, label edge cases, and provide structured feedback to retrain the modeling team.

You will compare responses, assign severity tags, label hallucinations and safety issues, and help calibrate scores through weekly inter-rater alignment. This contractor role requires clear reasoning and reliable weekly availability.

Qualifications

• Experience in evaluating or annotating French content for evaluation or trust & safety roles.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and rubric clause.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate French generalist model outputs against the versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them for rubric updates.
• Calibrate reviewer scores against gold-standard examples each week.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

French generalist evaluation

Job description

AuraOne is seeking a French Language Expert for a remote evaluation track to review French generalist prompts and responses against our quality rubric. Review paired outputs, label edge cases, and provide structured feedback to retrain the modeling team.

You will compare responses, assign severity tags, label hallucinations and safety issues, and help calibrate scores through weekly inter-rater alignment. This contractor role requires clear reasoning and reliable weekly availability.