Remote Machine Learning Quality & Policy Auditor

AuraOne, Inc.; United States; Remote; USD 102,000 - 146,000; Full time

Job summary

AuraOne, Inc. is hiring a remote Contractor Machine Learning Engineer Expert to evaluate AI outputs within specialist operations workflows. You will review tone, policy adherence, and escalation logic, and document the next steps for model training.

This is a contractor role requiring at least 10 hours per week, with US eligibility for remote work. The position emphasizes precise rubric-based judgment, interoperability with playbooks, and strong written reasoning to name the applicable policies,

Qualifications

• Direct working experience in machine learning engineer specialist operations on real teams for Machine Learning Engineer Expert work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current machine learning engineer specialist operations workflows, playbooks, and firm policy for Machine Learning Engineer Expert assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Machine Learning Engineer operations

Job description

AuraOne, Inc. is hiring a remote Contractor Machine Learning Engineer Expert to evaluate AI outputs within specialist operations workflows. You will review tone, policy adherence, and escalation logic, and document the next steps for model training.

This is a contractor role requiring at least 10 hours per week, with US eligibility for remote work. The position emphasizes precise rubric-based judgment, interoperability with playbooks, and strong written reasoning to name the applicable policies,