Dioula Bilingual Evaluation Specialist (Remote)

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Full time

Job summary

AuraOne is seeking a Dioula Bilingual Expert to remotely review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for retraining.

As an independent contractor, you will annotate outputs, tag issues, and help calibrate evaluators across batches. Reliable async availability of at least 10 hours per week is required.

The role is remote (US-eligible) with hourly compensation to be confirmed after interview.

Qualifications

• Experience evaluating bilingual evaluation prompts or related content.
• Ability apply rubrics consistently across long batches.
• Clear written reasoning naming issues and rubric clauses.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate model outputs against the rubric and assign severity tags.
• Compare paired responses and select the stronger one with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route for rubric updates.

Skills

Attention to detail

Written reasoning

Independent contractor

Availability 10h/wk

Job description

AuraOne is seeking a Dioula Bilingual Expert to remotely review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for retraining.

As an independent contractor, you will annotate outputs, tag issues, and help calibrate evaluators across batches. Reliable async availability of at least 10 hours per week is required.

The role is remote (US-eligible) with hourly compensation to be confirmed after interview.