Humanitarian AI Evaluation Specialist

OpenTrain AI, Inc.; United States; Remote; USD 41,000 - 96,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a part-time contractor to evaluate AI-generated responses on civilian protection, humanitarian action, and International Humanitarian Law.

You will judge reasoning under humanitarian constraints, focusing on civilian harm, protected persons, and proportionality, and create clear findings to guide model training. Candidates bring practical humanitarian judgment and a strong understanding of IHL; prior AI experience is not required.

Qualifications

• Strong humanitarian judgment and understanding of International Humanitarian Law.
• Professional fluency in English (written and spoken).
• Background in humanitarian operations, protection, or policy.
• Prior AI experience not required.

Responsibilities

• Create nuanced cases evaluating AI responses for humanitarian risks.
• Grade responses for accuracy, reasoning, depth, and sensitivity.
• Identify excessive caution or insufficient restraint in outputs.
• Document ambiguous cases with clear findings and recommendations.
• Contribute IHL and humanitarian principles to future training.

Skills

Humanitarian judgment

English proficiency

Proportionality reasoning

Job description

OpenTrain AI, Inc. is seeking a part-time contractor to evaluate AI-generated responses on civilian protection, humanitarian action, and International Humanitarian Law.

You will judge reasoning under humanitarian constraints, focusing on civilian harm, protected persons, and proportionality, and create clear findings to guide model training. Candidates bring practical humanitarian judgment and a strong understanding of IHL; prior AI experience is not required.