Remote Haitian Creole Evaluator & Rubric Specialist

AuraOne; United States; À distance; USD 34 000 - 55 000; Plein temps

Résumé du poste

AI Trainer Jobs is seeking a Haitian Creole Language Expert for a remote evaluation track. You will review language prompts and responses, compare outputs, label edge cases, and provide structured feedback to retrain models. This role emphasizes precise reasoning and rubric alignment.

Responsibilities include evaluating model outputs, tagging issues, and maintaining calibration with gold-standard examples. Remote, contractor role with hourly pay after interview.

Qualifications

• Prior evaluation, annotation or human-rater experience in Haitian Creole language evaluation.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and rubric clause applied.
• Reliable async availability for at least 10 hours per week.

Responsabilités

• Evaluate Haitian Creole outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route for rubric updates.
• Calibrate reviewer scores against gold-standard examples weekly.

Connaissances

Haitian Creole eval

Annotation experience

Written reasoning

Async availability

Description du poste

AI Trainer Jobs is seeking a Haitian Creole Language Expert for a remote evaluation track. You will review language prompts and responses, compare outputs, label edge cases, and provide structured feedback to retrain models. This role emphasizes precise reasoning and rubric alignment.

Responsibilities include evaluating model outputs, tagging issues, and maintaining calibration with gold-standard examples. Remote, contractor role with hourly pay after interview.