Remote AI Model Evaluation Reviewer - Database Migration

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Full time

Benefits offered by this job

Remote work

Hourly contract

US-eligible

Job summary

AuraOne is seeking a Database Migration Workflow Reviewer to join a remote evaluation track. Reviewers compare paired outputs against the quality rubric, label edge cases, and draft structured feedback for retraining the modeling team.

As a contractor, you will assess model outputs for severity, document reasoning, and flag hallucinations or policy violations. Strong written communication and at least 10 hours per week of async availability are required.

Qualifications

• Prior evaluation, annotation, or human-rater experience on database migration workflow evaluation or adjacent content.
• Clear written reasoning that names the issue and the rubric clause being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate database migration workflow evaluation model outputs against a versioned rubric and assign severity tags for Database Migration Workflow Reviewer assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.

Skills

Model evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Database Migration Workflow evaluation

Code review

Software testing

Agent evaluation

Database

Migration

Job description

AuraOne is seeking a Database Migration Workflow Reviewer to join a remote evaluation track. Reviewers compare paired outputs against the quality rubric, label edge cases, and draft structured feedback for retraining the modeling team.

As a contractor, you will assess model outputs for severity, document reasoning, and flag hallucinations or policy violations. Strong written communication and at least 10 hours per week of async availability are required.