Remote AI QA Engineer, Engineering Operations

AuraOne; United States; On-site; USD 117,096 - 158,424; Part time

Job summary

Qualifications

• Direct experience working on real engineering specialist operations teams.
• Comfort applying multi-page rubrics consistently.
• Clear written reasoning that names the policy or workflow used.

Responsibilities

• Review AI outputs against engineering specialist operations workflows, playbooks, and firm policy for Engineering Professional assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Engineering ops experience

Rubric application

Written reasoning

Attention to detail

Async availability

Job description