Cyber Threat Intelligence AI Evaluation SME

OpenTrain AI, Inc.; United States; Remote; USD 96,000 - 152,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a part-time contractor to evaluate AI responses to advanced cyber threat scenarios, including nation-state operations, surveillance, attribution, and intrusion-adjacent cases.

You will design evaluation cases, grade model outputs, and provide clear feedback. This role emphasizes practical cyber threat intelligence experience, strong written and verbal English, and the ability to work remotely across multiple time zones.

Qualifications

• Experience with threat-actor attribution, APT tracking, or adversary tactics and techniques.
• Strong judgment about defensive or analytic activity versus offensive or surveillance-focused requests.
• Experience mentoring, teaching, or leading threat intelligence professionals is valuable.

Responsibilities

• Map cyber threat intelligence cases to established taxonomies, especially for surveillance and privacy evaluation.
• Write boundary cases involving prohibited surveillance, attribution, and intrusion-adjacent requests.
• Evaluate responses for source reliability, analytic reasoning, stated limitations, and actionable value.
• Identify over-refusal when an AI system unnecessarily declines legitimate threat analysis.
• Document edge cases involving nation-state operations and advanced threats.
• Give concise written and verbal feedback to improve AI threat assessment.

Skills

Threat intel

English writing

Mentoring

Job description

Evaluate AI responses to advanced cyber threat scenarios, including nation-state operations, surveillance, attribution, and intrusion-adjacent cases. This part-time contractor role pays $70 to $110 per hour.

Remote Hourly · $70–$110/hr

$70–$110/hr

Compensation

Contract, part-time

Engagement

Remote

Open in 52 countries

India + more

• Algeria
• Argentina
• Austria
• Bahrain
• Bangladesh
• Belgium
• Brazil
• Canada
• Chile
• Colombia
• Denmark
• Egypt
• France
• Germany
• Ghana
• Greece
• India
• Indonesia
• Italy
• Japan
• Jordan
• Kazakhstan
• Kenya
• Kuwait
• Kyrgyzstan
• Lebanon
• Malaysia
• Mexico
• Morocco
• Netherlands
• Nigeria
• Oman
• Pakistan
• Palestine
• Peru
• Philippines
• Portugal
• Qatar
• Saudi Arabia
• Singapore
• South Africa
• Spain
• Sri Lanka
• Switzerland
• Taiwan
• Thailand
• Tunisia
• United Arab Emirates
• United Kingdom
• United States
• Uzbekistan
• Vietnam

The work

You will help evaluate AI systems that assess advanced cyber threat scenarios. The work focuses on setting clear boundaries between legitimate defensive analysis and impermissible surveillance, attribution, or intrusion-related requests.

You will create evaluation cases, grade model responses, document difficult edge cases, and give clear written and verbal feedback.

• Map cyber threat intelligence cases to established taxonomies, especially for surveillance and privacy evaluation.
• Write boundary cases involving prohibited surveillance, attribution, and intrusion-adjacent requests.
• Evaluate responses for source reliability, analytic reasoning, stated limitations, and actionable value.
• Identify over-refusal when an AI system unnecessarily declines legitimate threat analysis.
• Document edge cases involving nation-state operations and advanced threats.
• Give concise written and verbal feedback to improve AI threat assessment.

What it pays and takes

This is part-time contractor work for specialists who can apply practical cyber threat intelligence expertise to structured AI evaluation and feedback tasks.

• $70 to $110 per hour.
• Part-time contractor role.
• Open to candidates in the listed countries across the Americas, Europe, Asia, Africa, and the Middle East.
• Professional fluency in English, with clear structured writing and verbal communication.
• Substantial professional experience in cyber threat intelligence involving nation-state operations or advanced threats.
• Strong judgment about defensive or analytic activity versus offensive or surveillance-focused requests.
• Experience with threat-actor attribution, APT tracking, or adversary tactics and techniques.
• Experience mentoring, teaching, or leading threat intelligence professionals is valuable.
• Experience level: Entry level listing.
• Prior AI evaluation, red-teaming, or related quality assurance experience is helpful but not required.

About AI training work

AI training is the human work behind systems that learn from examples, including reviewing model answers and rating their quality. In this role, cyber threat intelligence expertise helps assess whether AI responses are accurate, useful, and appropriately limited.

Requirements

• Experience: Entry level

Evaluate large language model behavior in complex data pipelines, write structured test cases, and improve analytic methods as a remote contractor earning $60 to $100 per hour.

Review military scenarios and AI-generated responses using hands-on fires and targeting expertise. This part-time contract role pays $60 to $110 per hour and is open to candidates in several countries.

Create demanding questions, review AI-generated responses, and explain errors using authoritative sources. This part-time contract pays $30 to $60 per hour equivalent, paid per task that meets the project specifications.

Review AI conversations, identify missing context, and assess whether recommendations use enough information. This remote project runs for about three weeks, requires 20+ hours per week, and pays per task.

Remote · Albania, Algeria, Angola +128 more