Remote Security Onion QA & AI Evaluation Reviewer

AuraOne; United States; À distance; USD 96 000 - 138 000; Plein temps

Avantages offerts par ce poste

Remote work

Contractor employment

Résumé du poste

AuraOne seeks a Security Onion Specialist — Remote AI Evaluation Reviewer to join our contractor team. You will review AI outputs against security onion workflows, grade tone and policy adherence, and document the right next steps for model training.

You’ll work asynchronously for at least 10 hours weekly, applying multi-page rubrics, flagging gaps, and ensuring reviewer quality across batches. Strong written reasoning and daily reliability are essential.

Qualifications

• Direct working experience in security onion specialist operations on real teams.
• Clear written reasoning that names the policy or workflow being applied.
• Ability to apply multi-page rubrics consistently across long batches.
• Reliable async availability for at least 10 hours per week.

Responsabilités

• Review AI outputs against current security onion specialist operations workflows, playbooks, and firm policy.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Connaissances

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Security Onion operations

Description du poste

AuraOne seeks a Security Onion Specialist — Remote AI Evaluation Reviewer to join our contractor team. You will review AI outputs against security onion workflows, grade tone and policy adherence, and document the right next steps for model training.

You’ll work asynchronously for at least 10 hours weekly, applying multi-page rubrics, flagging gaps, and ensuring reviewer quality across batches. Strong written reasoning and daily reliability are essential.