Remote AI Humanities Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 96,000 - 138,000; Part time

Job summary

AuraOne is seeking a Humanities Evaluation Specialist to remotely review AI outputs within operations workflows. You will grade workflow correctness, policy adherence, and stakeholder fit, and document actionable next steps to guide the training team.

The role is remote for US-eligible contractors, with hourly compensation and flexible, independent schedule. Strong attention to detail and clear written reasoning are essential for success.

Qualifications

• Direct working experience in humanities evaluation specialist operations on real teams for Humanities Evaluation Specialist work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current humanities evaluation specialist operations workflows, playbooks, and firm policy for Humanities Evaluation Specialist assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.

Skills

Direct working experience

Rubric application

Written reasoning

Attention to detail

Async availability

Tools

AI-assisted workflow tooling

Job description

AuraOne is seeking a Humanities Evaluation Specialist to remotely review AI outputs within operations workflows. You will grade workflow correctness, policy adherence, and stakeholder fit, and document actionable next steps to guide the training team.

The role is remote for US-eligible contractors, with hourly compensation and flexible, independent schedule. Strong attention to detail and clear written reasoning are essential for success.