Remote AI Evaluation Specialist: Recent Grad

AI Trainer Jobs; United States; Remote; USD 99,000 - 135,000; Full time

Job summary

AuraOne is seeking an Evaluation Specialist/Recent Grad for a remote review track to evaluate AI outputs across evaluation and recent grad specialist operations workflows. You will grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.

As an independent contractor, you will operate remotely with US eligibility, and compensation is hourly, confirmed after interview.

Qualifications

• Direct working experience in evaluation /recent grad specialist operations on real teams.
• Clear written reasoning that names the policy or workflow being applied.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current evaluation/recent grad specialist operations workflows, playbooks, and firm policy for Evaluation Specialist/Recent Grad assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Evaluation /Recent Grad operations

Job description

AuraOne is seeking an Evaluation Specialist/Recent Grad for a remote review track to evaluate AI outputs across evaluation and recent grad specialist operations workflows. You will grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.

As an independent contractor, you will operate remotely with US eligibility, and compensation is hourly, confirmed after interview.