Remote Sampling Bias QA Specialist - Contractor

AuraOne; United States; On-site; USD 41,328 - 75,768; Full time

Job summary

AuraOne is seeking a remote Sampling Bias Data Specialist contractor in the United States. You will review AI outputs, assess workflow alignment with current playbooks, and document next steps so the modeling team can train on gaps.

You will apply multi-page rubrics, provide clear written reasoning naming the policies used, and flag risks with severity tags. This role requires reliable async availability for at least 10 hours/week and US work authorization.

Qualifications

• Direct working experience in sampling bias data specialist operations on real teams for Sampling Bias Data Specialist work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current sampling bias data specialist operations workflows, playbooks, and firm policy for Sampling Bias Data Specialist assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Sampling Bias Data specialist ops

Data quality

Taxonomy design

Ontology review

Sampling

Bias

Job description

AuraOne is seeking a remote Sampling Bias Data Specialist contractor in the United States. You will review AI outputs, assess workflow alignment with current playbooks, and document next steps so the modeling team can train on gaps.

You will apply multi-page rubrics, provide clear written reasoning naming the policies used, and flag risks with severity tags. This role requires reliable async availability for at least 10 hours/week and US work authorization.