Intelligence Analyst (English)

OpenTrain AI, Inc.

EE. UU.

A distancia

USD 41.000 - 110.000

A tiempo parcial

hace 7 horas
Sé de los primeros/as/es en solicitar esta vacante

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Ventajas ofrecidas por este puesto de trabajo

Remote work
Part-time contract

Descripción de la vacante

OpenTrain AI, Inc. is seeking a remote, part-time contractor to evaluate AI-generated responses, test source handling, and analytic reasoning, applying intelligence tradecraft and standards.

You will map analytic cases to defined taxonomies, write test cases, and assess responses against criteria, documenting model limits and uncertainties. English fluency is required, and 20+ hours per week are typical.

Formación

  • English fluency required.
  • Entry level experience.
  • Knowledge: source evaluation, confidence-level assessment, established analytic standards, structured analytic techniques, and intelligence tradecraft.

Responsabilidades

  • Map analytic cases to defined taxonomies across several intelligence evaluation areas.
  • Write complex test cases that examine source use, analytic rigor, uncertainty, and practical usefulness.
  • Assess and grade AI-generated responses against clear analytic criteria.
  • Identify and document over-refusal, edge cases, analytic disagreements, and model limitations.
  • Help refine source-evaluation procedures and confidence-level assignments.
  • Share expert feedback that improves analytic standards and AI evaluation benchmarks.

Conocimientos

English fluency

Descripción del empleo

Evaluate AI-generated intelligence responses, test source handling and analytic reasoning, and document model limits. This remote, part-time contractor role pays $30 to $80 per hour and requires English fluency.

Remote Hourly · $30–$80/hr

$30–$80/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Oct 23, 2026

Posted

Open in 52 countries

  • Algeria
  • Argentina
  • Austria
  • Bahrain
  • Bangladesh
  • Belgium
  • Brazil
  • Canada
  • Chile
  • Colombia
  • Denmark
  • Egypt
  • France
  • Germany
  • Ghana
  • Greece
  • India
  • Indonesia
  • Italy
  • Japan
  • Jordan
  • Kazakhstan
  • Kenya
  • Kuwait
  • Kyrgyzstan
  • Lebanon
  • Malaysia
  • Mexico
  • Morocco
  • Netherlands
  • Nigeria
  • Oman
  • Pakistan
  • Palestine
  • Peru
  • Philippines
  • Portugal
  • Qatar
  • Saudi Arabia
  • Singapore
  • South Africa
  • Spain
  • Sri Lanka
  • Switzerland
  • Taiwan
  • Thailand
  • Tunisia
  • United Arab Emirates
  • United Kingdom
  • United States
  • Uzbekistan
  • Vietnam
The Work

You will help evaluate artificial intelligence systems using structured intelligence scenarios, analytic cases, test cases, and model-generated responses. Your work will apply intelligence tradecraft and analytic standards to judge whether responses are well supported, useful, and appropriately cautious.

  • Map analytic cases to defined taxonomies across several intelligence evaluation areas.
  • Write complex test cases that examine source use, analytic rigor, uncertainty, and practical usefulness.
  • Assess and grade AI-generated responses against clear analytic criteria.
  • Identify and document over-refusal, edge cases, analytic disagreements, and model limitations.
  • Help refine source-evaluation procedures and confidence-level assignments.
  • Share expert feedback that improves analytic standards and AI evaluation benchmarks.
What It Pays And Takes

This is remote, part-time contractor work for candidates in the countries listed for the role. English fluency is required, along with the ability to explain nuanced judgments clearly in writing and conversation.

  • Pay: $30 to $80 per hour.
  • Work arrangement: Remote, part-time contract.
  • Location: Open to candidates across the listed countries, including the United States, Canada, the United Kingdom, India, Japan, Singapore, and South Africa.
  • Experience level: Entry level.
  • Background: Demonstrated all-source analytic experience or deep expertise in a specific analytic discipline.
  • Knowledge: Source evaluation, confidence-level assessment, established analytic standards, structured analytic techniques, and intelligence tradecraft.
  • Communication: Exceptional written and verbal communication, with experience teaching, mentoring, or leading analytic reviews.
  • Judgment: Ability to recognize and explain model limitations and over-refusal scenarios.
  • Helpful background: Previous AI evaluation or model assessment experience is helpful but not required.
About AI Training Work

AI training is the human work behind artificial intelligence, including writing test cases, rating model responses, and checking whether systems handle information accurately. People with strong subject knowledge are paid to apply careful judgment and help make AI systems more useful and reliable.

Requirements
  • Experience: Entry level

Evaluate AI-generated political content for analytical quality, rigor, and evidence-based reasoning. This part-time U.S. contract offers up to $75 per hour and requires 20+ hours per week.

Evaluate AI-generated economics content for formal accuracy, rigor, and relevance at $75 per hour. Use your economics research expertise in a flexible, 20-plus-hour weekly contract role open to candidates in the United States.

Design realistic AI benchmark tasks based on payroll, workforce planning, HR policies, and employee lifecycle work. Earn $45 to $90 per hour with less than 20 hours per week.

Use business operations expertise to review AI model outputs, apply clear rubrics, and explain your judgments. This remote contract role pays $45 to $90 per hour and typically requires less than 20 hours per week.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Cyber Threat Intelligence AI Evaluation SME
Cyber Threat Intelligence AI Evaluation SME

OpenTrain AI, Inc. • EE. UU.

A distancia
USD 96.000 - 152.000
AI Content Evaluation QA
AI Content Evaluation QA

OpenTrain AI, Inc. • EE. UU.

A distancia
USD 55.000 - 124.000
Military Legal AI Evaluation Advisor (English)
Military Legal AI Evaluation Advisor (English)

OpenTrain AI, Inc. • EE. UU.

A distancia
USD 96.000 - 165.000
Military Weapons Systems Scenario Evaluator
Military Weapons Systems Scenario Evaluator

OpenTrain AI, Inc. • EE. UU.

A distancia
USD 55.000 - 110.000
LLM Content Evaluation Analyst
LLM Content Evaluation Analyst

OpenTrain AI, Inc. • EE. UU.

A distancia
USD 62.000 - 124.000
Remote work
Humanitarian AI Evaluation Expert (English)
Humanitarian AI Evaluation Expert (English)

OpenTrain AI, Inc. • EE. UU.

A distancia
USD 41.000 - 96.000
Research Evaluation Specialist
Research Evaluation Specialist

OpenTrain AI, Inc. • EE. UU.

A distancia
USD 41.000 - 83.000
Data Science Methodology SME
Data Science Methodology SME

OpenTrain AI, Inc. • EE. UU.

A distancia
USD 83.000 - 138.000
AI Generalist Digital Workflow Evaluator
AI Generalist Digital Workflow Evaluator

OpenTrain AI, Inc. • EE. UU.

A distancia
USD 41.000 - 68.000
Business Analyst, AI Agent Evaluation
Business Analyst, AI Agent Evaluation

OpenTrain AI, Inc. • EE. UU.

A distancia
USD 28.000 - 55.000
Part-time contractor