Remote Application Security AI Quality Reviewer

AuraOne; United States; On-site; USD 55,000 - 96,000; Part time

Job summary

AuraOne seeks an Applications Security AI Specialist contractor to review AI outputs within operations workflows. You will assess workflow correctness, policy adherence, and stakeholder fit, and document next steps to train the model. You will work remotely from the US with a structured rubric to grade tone and escalation.

You will ensure risk flags are properly captured and escalations handled per firm guidance, with at least 10 hours per week.

Qualifications

• Direct working experience in application security ai specialist operations on real teams for Application Security AI Specialist work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current application security ai specialist operations workflows, playbooks, and firm policy for Application Security AI Specialist assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Direct working experience in App Sec A

Comfort applying rubrics

Clear written reasoning

Attention to detail

Async availability 10h/wk

Job description

AuraOne seeks an Applications Security AI Specialist contractor to review AI outputs within operations workflows. You will assess workflow correctness, policy adherence, and stakeholder fit, and document next steps to train the model. You will work remotely from the US with a structured rubric to grade tone and escalation.

You will ensure risk flags are properly captured and escalations handled per firm guidance, with at least 10 hours per week.