Remote AI Evaluation Specialist - Multimodal Physics

AI Trainer Jobs; United States; Remote; USD 45,000 - 65,000; Part time

Benefits offered by this job

Remote work

Contractor role

Flexible schedule

Job summary

AuraOne is seeking contractors to review multimodal physics evaluation prompts and responses. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain models.

As a remote role with US-eligibility, you will judge model behavior on text, images, and documents, writing clear rationales and tagging issues for improvement. Expected commitment is flexible but requires reliable async availability.

Qualifications

• Prior evaluation, annotation, or human-rater experience in multimodal evaluation.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause applied.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and choose stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route to program team for rubric updates.
• Calibrate reviewer scores against gold-standard examples weekly.

Skills

Evaluation experience

Rubric application

Attention to detail

Strong written reasoning

Async availability

Tools

Annotation tools

Job description

AuraOne is seeking contractors to review multimodal physics evaluation prompts and responses. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain models.

As a remote role with US-eligibility, you will judge model behavior on text, images, and documents, writing clear rationales and tagging issues for improvement. Expected commitment is flexible but requires reliable async availability.