Remote AI Benchmark & Task Design Reviewer

AI Trainer Jobs; United States; Remote; USD 41,000 - 83,000; Full time

Benefits offered by this job

Remote work

Flexible schedule

Contractor role

Job summary

AI Trainer Jobs is seeking a remote AI Benchmark and Task Designer reviewer to evaluate outputs against craft, constraints, and tooling standards. You will document the corrected approach so the team can train on it and help ensure production-readiness across AI reviews.

The role emphasizes independent contractor work, with flexible hours and an hourly rate; remote work is available to qualified candidates in the United States.

Qualifications

• Portfolio or production experience in ai benchmark and task designer creative review or an adjacent creative discipline.
• Clear written reasoning that names the craft issue and the standard being applied.
• Hands-on familiarity with the standard tooling for the discipline.

Responsibilities

• Review AI outputs against current craft, tooling standards, and rubric.
• Grade composition, constraint adherence, and production-readiness on a structured rubric.
• Flag tooling-specific failures (file format, scale, naming, layer hygiene) with severity tags.
• Capture the corrected approach or reference so the modeling team can train on it.

Skills

Portfolio review

Attention to detail

Written reasoning

Familiarity with AI benchmarks

Cross-functional collaboration

Tools

Rubric writing guides

Job description

AI Trainer Jobs is seeking a remote AI Benchmark and Task Designer reviewer to evaluate outputs against craft, constraints, and tooling standards. You will document the corrected approach so the team can train on it and help ensure production-readiness across AI reviews.

The role emphasizes independent contractor work, with flexible hours and an hourly rate; remote work is available to qualified candidates in the United States.