Remote Defense & Intelligence AI Evaluation Specialist

AuraOne Human Data

United States

Remote

USD 119,000 - 170,000

Part time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AuraOne, Inc. is seeking a remote, contractor reviewer for Defense and Intelligence Specialists AI Evaluation. The role involves assessing AI outputs against defense workflows, ensuring policy alignment, and documenting actionable next steps for model training.

You will grade tone, escalation logic, and stakeholder fit, flag gaps, and contribute to maintaining high inter-rater calibration standards with flexible weekly hours.

Qualifications

  • Experience performing operational reviews in defense/intelligence contexts.
  • Ability to apply policy and workflow rules consistently.
  • Clear written reasoning naming applicable policies or workflows.
  • Attention to detail and ability to flag prompt issues.

Responsibilities

  • Review AI outputs against defense/intelligence workflows, playbooks, and firm policy.
  • Grade tone, escalation logic, and stakeholder fit on a structured rubric.
  • Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
  • Capture the right next steps so the modeling team can train on it.
  • Adjudicate disputed playbook calls using firm guidance.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Operational review
Policy adherence
Workflow judgment
Stakeholder communication
Defense and Intelligence Specialists

Job description

AuraOne, Inc. is seeking a remote, contractor reviewer for Defense and Intelligence Specialists AI Evaluation. The role involves assessing AI outputs against defense workflows, ensuring policy alignment, and documenting actionable next steps for model training.

You will grade tone, escalation logic, and stakeholder fit, flag gaps, and contribute to maintaining high inter-rater calibration standards with flexible weekly hours.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Intelligence Analyst — Security AI Evaluation Remote
Senior Intelligence Analyst — Security AI Evaluation Remote

AuraOne Human Data • United States

Remote
USD 55,000 - 83,000
Remote AI Evaluation Specialist — Military Readiness
Remote AI Evaluation Specialist — Military Readiness

AuraOne Human Data • United States

Remote
USD 55,000 - 96,000
Remote AI Review Specialist - Military Ops & Reporting
Remote AI Review Specialist - Military Ops & Reporting

AuraOne, Inc. • United States

Remote
USD 55,000 - 96,000
Remote AI Review Specialist — Civilian & Allied Gov Ops
Remote AI Review Specialist — Civilian & Allied Gov Ops

AuraOne Human Data • United States

Remote
USD 55,000 - 83,000
Defense and Intelligence Specialists, AI Evaluation
Defense and Intelligence Specialists, AI Evaluation

AuraOne Human Data • United States

Remote
USD 119,000 - 170,000
Remote Intelligence QA Analyst (Contractor)
Remote Intelligence QA Analyst (Contractor)

AuraOne Human Data • United States

Remote
USD 55,000 - 83,000
Health insurance
Remote Evaluation Specialist, AI Domain Ops
Remote Evaluation Specialist, AI Domain Ops

AuraOne Human Data • United States

Remote
USD 34,000 - 62,000
AI Review Specialist for Civilian Intelligence Ops (Remote)
AI Review Specialist for Civilian Intelligence Ops (Remote)

AuraOne Human Data • United States

Remote
USD 41,000 - 76,000
Remote Intelligence Officer AI QA Reviewer (Contractor)
Remote Intelligence Officer AI QA Reviewer (Contractor)

AuraOne Human Data • United States

Remote
USD 34,000 - 83,000
Remote AI Evaluation Specialist Counterintelligence
Remote AI Evaluation Specialist Counterintelligence

AuraOne Human Data • United States

Remote
USD 34,000 - 62,000