AI Benchmark and Task Designer

AI Trainer Jobs; United States; Remote; USD 41,000 - 83,000; Full time

Benefits offered by this job

Remote work

Flexible schedule

Contractor role

Job summary

AI Trainer Jobs is seeking a remote AI Benchmark and Task Designer reviewer to evaluate outputs against craft, constraints, and tooling standards. You will document the corrected approach so the team can train on it and help ensure production-readiness across AI reviews.

The role emphasizes independent contractor work, with flexible hours and an hourly rate; remote work is available to qualified candidates in the United States.

Qualifications

• Portfolio or production experience in ai benchmark and task designer creative review or an adjacent creative discipline.
• Clear written reasoning that names the craft issue and the standard being applied.
• Hands-on familiarity with the standard tooling for the discipline.

Responsibilities

• Review AI outputs against current craft, tooling standards, and rubric.
• Grade composition, constraint adherence, and production-readiness on a structured rubric.
• Flag tooling-specific failures (file format, scale, naming, layer hygiene) with severity tags.
• Capture the corrected approach or reference so the modeling team can train on it.

Skills

Portfolio review

Attention to detail

Written reasoning

Familiarity with AI benchmarks

Cross-functional collaboration

Tools

Rubric writing guides

Job description

About the role

AI Benchmark and Task Designer is a remote review track for evaluating AI outputs across ai benchmark and task designer creative review workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling team can train on it.
AI Benchmark and Task Designer creative review AI is only useful if a working professional would actually ship the output. AuraOne uses portfolio-credentialed reviewers to grade outputs the way a senior creative would — with craft, constraints, and tooling all in scope.
Judge creative and design output against professional standards. Craft counts.

Responsibilities

• Review AI outputs against current ai benchmark and task designer creative review craft and tooling standards for AI Benchmark and Task Designer assignments.
• Grade composition, constraint adherence, and production-readiness on a structured rubric.
• Flag tooling-specific failures (file format, scale, naming, layer hygiene) with severity tags.
• Capture the corrected approach or reference so the modeling team can train on it.

Role details

Track Design & creative review Work model Remote · Independent specialist contractor Compensation Hourly rate confirmed after the interview process. Eligible from US

What you should bring

• Portfolio or production experience in ai benchmark and task designer creative review or an adjacent creative discipline for AI Benchmark and Task Designer work.
• Hands-on familiarity with the standard tooling for the discipline.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the craft issue and the standard being applied.
• Reliable async availability for at least 10 hours per week.

Role signals

Example tasks

• Grade a model's ai benchmark and task designer creative review output against the brief and rate craft, constraints, and production-readiness.
• Flag a tooling-specific failure (incorrect file format, unsupported feature, naming convention) with severity.
• Adjudicate a disputed creative judgment between two reviewers using a firm style guide.
• Audit a 25-asset batch for rubric consistency and report drift to the program lead.

Useful experience

• Studio, agency, or in-house team experience shipping production work.
• Prior experience reviewing AI-assisted creative tooling and its failure modes.
• Familiarity with AAA or feature-grade pipelines and asset standards.

Compensation and schedule

Hourly rate confirmed after the interview process.
Expected arrangement: contractor , with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.

Skills used in matching

• Creative review
• Production-grade craft
• Tooling fluency
• Asset evaluation
• AI Benchmark and Task Designer creative review
• Cross-cutting evaluation roles
• AI evaluation
• Rubric writing
• Expert review

Application boundary

Creating a specialist profile records your experience and preferences. Starting role intake is a separate action that attaches this role to your candidate record.

Specialist intake

The intake preserves your chosen role, the visible terms, and source attribution for reviewer context.

• 01 Confirm profile and eligibility details.
• 02 Attach this role deliberately.
• 03 Receive a human review decision or follow-up.
  Placement timing depends on program demand and reviewer confirmation.