Humanitarian AI Evaluation Expert (English)

OpenTrain AI, Inc.; United States; Remote; USD 41,000 - 96,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a part-time contractor to evaluate AI-generated responses on civilian protection, humanitarian action, and International Humanitarian Law.

You will judge reasoning under humanitarian constraints, focusing on civilian harm, protected persons, and proportionality, and create clear findings to guide model training. Candidates bring practical humanitarian judgment and a strong understanding of IHL; prior AI experience is not required.

Qualifications

• Strong humanitarian judgment and understanding of International Humanitarian Law.
• Professional fluency in English (written and spoken).
• Background in humanitarian operations, protection, or policy.
• Prior AI experience not required.

Responsibilities

• Create nuanced cases evaluating AI responses for humanitarian risks.
• Grade responses for accuracy, reasoning, depth, and sensitivity.
• Identify excessive caution or insufficient restraint in outputs.
• Document ambiguous cases with clear findings and recommendations.
• Contribute IHL and humanitarian principles to future training.

Skills

Humanitarian judgment

English proficiency

Proportionality reasoning

Job description

Review AI-generated responses about civilian protection, humanitarian action, and International Humanitarian Law. This part-time contractor role pays $30 to $70 per hour and needs strong humanitarian judgment, with no prior AI experience required.

Remote Hourly · $30–$70/hr

$30–$70/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Oct 23, 2026

Posted

Open in 51 countries

Portugal + more

• Algeria
• Argentina
• Austria
• Bahrain
• Bangladesh
• Belgium
• Brazil
• Canada
• Chile
• Colombia
• Denmark
• Egypt
• France
• Germany
• Ghana
• Greece
• India
• Indonesia
• Italy
• Japan
• Jordan
• Kazakhstan
• Kenya
• Kuwait
• Kyrgyzstan
• Lebanon
• Malaysia
• Mexico
• Morocco
• Netherlands
• Nigeria
• Oman
• Pakistan
• Palestine
• Peru
• Philippines
• Portugal
• Qatar
• Saudi Arabia
• Singapore
• South Africa
• Spain
• Sri Lanka
• Switzerland
• Taiwan
• Thailand
• Tunisia
• United Arab Emirates
• United States
• Uzbekistan
• Vietnam

The work

You will help evaluate how well AI systems reason about humanitarian scenarios. Your work will focus on civilian harm, protected persons, proportionality, legitimate activity, and humanitarian constraints.

You will create challenging cases, assess model responses, identify humanitarian risks, and record clear findings that can guide future model training and refinement.

• Create nuanced scenarios about civilian protection and humanitarian action.
• Grade AI responses for accuracy, reasoning, depth, and sensitivity to civilian-harm concerns.
• Identify excessive caution, insufficient restraint, and other humanitarian risks.
• Document ambiguous or difficult cases with clear findings and recommendations.
• Contribute International Humanitarian Law and humanitarian principles for future training.

What it pays and takes

This is a part-time contractor opportunity. The work requires practical humanitarian judgment and a strong understanding of International Humanitarian Law and civilian-protection principles.

• Pay: $30 to $70 per hour.
• Work type: Part-time contractor role.
• Location: Open to candidates in the countries listed for this opportunity, including the United States, Canada, France, Germany, India, Japan, Kenya, Nigeria, Singapore, South Africa, and Vietnam.
• Language: Professional fluency in English, including clear written and spoken communication.
• Required background: Humanitarian operations, protection, or policy experience.
• Required knowledge: International Humanitarian Law, civilian-protection principles, and proportionality reasoning in conflict or protection scenarios.
• Helpful experience: Teaching, training, field leadership, documenting difficult cases, or disseminating International Humanitarian Law.
• Valuable background: Work with the ICRC or Red Cross, UN agencies, major NGOs, conflict-zone fieldwork, or protection-cluster participation.
• Prior AI experience is not required.

About AI training work

AI training is the human work behind systems that learn from examples and expert feedback. In this role, your humanitarian judgment helps assess whether AI responses are accurate, well-reasoned, and appropriately sensitive to civilian protection.

Requirements

• Experience: Entry level

Evaluate AI-generated political content for analytical quality, rigor, and evidence-based reasoning. This part-time U.S. contract offers up to $75 per hour and requires 20+ hours per week.

Evaluate AI-generated economics content for formal accuracy, rigor, and relevance at $75 per hour. Use your economics research expertise in a flexible, 20-plus-hour weekly contract role open to candidates in the United States.

Design realistic AI benchmark tasks based on payroll, workforce planning, HR policies, and employee lifecycle work. Earn $45 to $90 per hour with less than 20 hours per week.

Use business operations expertise to review AI model outputs, apply clear rubrics, and explain your judgments. This remote contract role pays $45 to $90 per hour and typically requires less than 20 hours per week.