Signals Intelligence (SIGINT) Expert - AI Evaluation (Remote)

AuraOne Human Data; United States; Remote; USD 55,000 - 110,000; Full time

Benefits offered by this job

Remote work

Contractor status

Job summary

AuraOne, Inc. seeks a Signals Intelligence (SIGINT) Expert for AI Evaluation in a remote US-eligible contractor role. You will review AI outputs, assess workflow adherence, and flag risks to guide model training efforts.

Responsibilities include grading tone and escalation, documenting policy-based decisions, and maintaining calibration scores across batches. Prior experience on real NSA/SIGINT operations teams is required.

Qualifications

• Direct working experience in NSA/SIGINT operations on real teams.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against NSA/SIGINT workflows, playbooks, and firm policy for SIGINT Expert - AI Evaluation (Remote) assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

NSA / SIGINT operations

Job description

Signals Intelligence (SIGINT) Expert - AI Evaluation (Remote) is a remote review track for evaluating AI outputs across nsa / signals intelligence specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.

Why this role matters

NSA / Signals Intelligence specialist operations AI has to fit into an actual day at work. AuraOne uses experienced operators to grade outputs the way a senior peer would — checking workflow, policy, and the unwritten rules that decide whether a task actually gets done.

Responsibilities

• Review AI outputs against current nsa / signals intelligence specialist operations workflows, playbooks, and firm policy for Signals Intelligence (SIGINT) Expert - AI Evaluation (Remote) assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

• Direct working experience in nsa / signals intelligence specialist operations on real teams for Signals Intelligence (SIGINT) Expert - AI Evaluation (Remote) work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Example tasks

• Grade a model's response to a real nsa / signals intelligence specialist operations ticket and rate workflow, tone, and escalation.
• Flag a missed escalation with the right severity tag and corrected next step.
• Adjudicate a disputed playbook call between two reviewers using firm guidance.
• Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

• Prior experience training, calibrating, or QA-ing operations teams.
• Familiarity with AI-assisted workflow tooling and its failure modes.
• Bilingual experience for cross-region operations.

Skills

• Operational review
• Policy adherence
• Workflow judgment
• Stakeholder communication
• NSA / Signals Intelligence specialist operations

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Direct working experience in nsa / signals intelligence specialist operations on real teams for Signals Intelligence (SIGINT) Expert - AI Evaluation (Remote) work. Comfort applying multi-page rubrics consistently across long batches. Clear written reasoning that names the policy or workflow being applied. Strong attention to detail and the ability to flag when a prompt itself is the problem. Reliable async availability for at least 10 hours per week.