Remote French AI Evaluator & Rubric Reviewer (US/Canada)

AuraOne Human Data

United States

Remote

USD 45,000 - 65,000

Part time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne, Inc. is seeking a French AI Evaluation Specialist (US/Canada) for a remote contractor position.

You will review French generalist evaluation prompts and responses, comparing paired outputs, labeling edge cases, and drafting structured feedback to help retrain the modeling system. Responsibilities include evaluating model outputs against a rubric, selecting the stronger answer with rationale, tagging issues, and calibrating scores with gold-standard examples on a weekly cadence.

Qualifications

  • Experience in model output evaluation using rubrics.
  • Ability to annotate with severity tags and reasoning.
  • Clear written reasoning citing rubric clauses and edge cases.

Responsibilities

  • Evaluate French generalist evaluation model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples weekly.
  • Document recurring failure modes for model retraining.

Skills

Model evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
French generalist evaluation
AI model evaluation

Job description

AuraOne, Inc. is seeking a French AI Evaluation Specialist (US/Canada) for a remote contractor position.

You will review French generalist evaluation prompts and responses, comparing paired outputs, labeling edge cases, and drafting structured feedback to help retrain the modeling system. Responsibilities include evaluating model outputs against a rubric, selecting the stronger answer with rationale, tagging issues, and calibrating scores with gold-standard examples on a weekly cadence.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

French Language Evaluator & Rubric Expert — Remote
French Language Evaluator & Rubric Expert — Remote

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
French AI Evaluation Specialist (US / Canada)
French AI Evaluation Specialist (US / Canada)

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote French Bilingual AI Output Reviewer & Annotator
Remote French Bilingual AI Output Reviewer & Annotator

AuraOne Human Data • United States

Remote
USD 30,000 - 52,000
Remote French-Canadian Voice Evaluation Specialist
Remote French-Canadian Voice Evaluation Specialist

Auraone • United States

Remote
USD 62,000 - 413,000
French Language Expert (France)
French Language Expert (France)

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Remote French-Language AI Model Review Analyst
Remote French-Language AI Model Review Analyst

AuraOne Human Data • United States

Remote
USD 25,000 - 44,000
French Evaluation & Annotation Specialist (Remote Canada)
French Evaluation & Annotation Specialist (Remote Canada)

Auraone • United States

Remote
USD 34,000 - 55,000
French Evaluator (Be/CH) - Remote Rubric Specialist
French Evaluator (Be/CH) - Remote Rubric Specialist

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Remote French Marketing Docs Evaluator
Remote French Marketing Docs Evaluator

Auraone • United States

Remote
USD 41,000 - 55,000
Remote work
Hourly contractor
French-Language Audio/Voice Annotation Trainer
French-Language Audio/Voice Annotation Trainer

AuraOne Human Data • United States

Remote
USD 28,000 - 55,000
Remote work
Contractor role