AI Model Training Reviewer — Operations & QA (Remote)

AuraOne Human Data; United States; Remote; USD 55,000 - 110,000; Full time

Job summary

AuraOne, Inc. seeks a remote Member of Technical Staff, Model Training (infra & platform) specialist operations to review AI outputs and ensure alignment with workflows and policy.

The role emphasizes structured rubrics, tone assessment, and identifying escalation gaps, with a focus on documenting the next steps for training the modeling team. The contractor will work asynchronously at least 10 hours per week, applying detailed reasoning to adjudicate prompts and maintain consistency across

Qualifications

• Direct working experience in member of technical staff model training specialist operations on real teams.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current member of technical staff model training specialist operations workflows, playbooks, and firm policy for assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Model training operations

AI model evaluation

Job description

AuraOne, Inc. seeks a remote Member of Technical Staff, Model Training (infra & platform) specialist operations to review AI outputs and ensure alignment with workflows and policy.

The role emphasizes structured rubrics, tone assessment, and identifying escalation gaps, with a focus on documenting the next steps for training the modeling team. The contractor will work asynchronously at least 10 hours per week, applying detailed reasoning to adjudicate prompts and maintain consistency across