Senior Intelligence Evaluation & AI Review (Remote)

Alpheva; United States; Remote; USD 248,000 - 317,000; Part time

Benefits offered by this job

Remote work

Contract-based project

Job summary

Alpheva is seeking a senior intelligence expert for remote, project-based work evaluating AI outputs, source reliability, and analytic confidence. You will review model responses and worked examples to identify incorrect assumptions and gaps in constraints.

The role requires 7+ years in intelligence analysis, senior judgment in source evaluation and collection gaps, and the ability to justify corrections with traceable evidence. Pay is hourly ($180–$230/hr) with onboarding terms to be announced.

Qualifications

• 7+ years of substantive experience in intelligence analysis.
• Senior-level judgment in evaluating sources and analytic confidence.
• Ability to justify corrections with traceable evidence.
• Write precise reference answers and scoring criteria.
• Use only public or project-authorized material; no classified information.

Responsibilities

• Review model responses and worked examples for incorrect assumptions and unsupported analytic confidence.
• Assess whether reasoning meets professional standards for the stated task.
• Explain consequential errors and evidence gaps, and provide corrections.

Skills

Intelligence analysis

Source evaluation

Analytic confidence

Collection gaps

Intelligence products

Reference answers

Evidence justification

Job description

Alpheva is seeking a senior intelligence expert for remote, project-based work evaluating AI outputs, source reliability, and analytic confidence. You will review model responses and worked examples to identify incorrect assumptions and gaps in constraints.

The role requires 7+ years in intelligence analysis, senior judgment in source evaluation and collection gaps, and the ability to justify corrections with traceable evidence. Pay is hourly ($180–$230/hr) with onboarding terms to be announced.