Remote Multimodal Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 47,000 - 63,000; Full time

Job summary

AuraOne is seeking a Cross-Modal Retrieval Model Evaluator for a remote evaluation track reviewing prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and write structured feedback to help retrain the model.

As an independent contractor, you will review text, images, and documents, flag issues, and provide clear rationales. Availability around 10 hours per week, pay $40/hr, rate confirmed after interview.

Qualifications

• Prior evaluation, annotation, or human-rater experience on cross modal retrieval evaluation.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and rubric clause.
• Strong attention to detail and flag when prompts are problematic.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route to the program team for rubric updates.

Skills

Cross-modal evaluation

Annotation experience

Structured feedback writing

Attention to detail

Independent contractor work

Job description

AuraOne is seeking a Cross-Modal Retrieval Model Evaluator for a remote evaluation track reviewing prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and write structured feedback to help retrain the model.

As an independent contractor, you will review text, images, and documents, flag issues, and provide clear rationales. Availability around 10 hours per week, pay $40/hr, rate confirmed after interview.