Remote AI Systems Architect QA Lead & Policy Reviewer

AuraOne Human Data; United States; Remote; USD 55,000 - 103,000; Full time

Job summary

AuraOne, Inc. is seeking a Systems Architect / Chief Systems Architect specialist operations reviewer for a remote, contractor-based role.

The position focuses on evaluating AI outputs against established workflows, policies, and firm guidance, with emphasis on practical day-to-day applicability. You will grade tone and escalation, identify policy-adherence gaps, and document the next steps to train the modeling team.

Qualifications

• Direct working experience in systems architect / chief systems architect specialist operations on real teams for Systems Architect / Chief Systems Architect work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current systems architect / chief systems architect specialist operations workflows, playbooks, and firm policy for Systems Architect / Chief Systems Architect assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Systems Architect / Chief Systems Arch

Software engineering

Job description

AuraOne, Inc. is seeking a Systems Architect / Chief Systems Architect specialist operations reviewer for a remote, contractor-based role.

The position focuses on evaluating AI outputs against established workflows, policies, and firm guidance, with emphasis on practical day-to-day applicability. You will grade tone and escalation, identify policy-adherence gaps, and document the next steps to train the modeling team.