Remote Career Coach AI QA Specialist

AuraOne; United States; On-site; USD 48,000 - 90,000; Part time

Job summary

AuraOne seeks a skilled contractor to review AI outputs for Career Coach operations, ensuring alignment with workflows, policy, and stakeholder expectations. You will grade tone, escalation, and adherence using a structured rubric.

Excellent written reasoning, attention to detail, and the ability to flag prompt issues are essential. This remote role requires at least 10 hours per week, with contractor flexibility across time zones.

Qualifications

• Direct working experience in career coach operations on real teams.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current career coach specialist operations workflows, playbooks, and firm policy for Career Coach assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Career Coach specialist operations

Job description

AuraOne seeks a skilled contractor to review AI outputs for Career Coach operations, ensuring alignment with workflows, policy, and stakeholder expectations. You will grade tone, escalation, and adherence using a structured rubric.

Excellent written reasoning, attention to detail, and the ability to flag prompt issues are essential. This remote role requires at least 10 hours per week, with contractor flexibility across time zones.