Human Intelligence Interview Evaluator

OpenTrain AI, Inc.; United States; Hybrid; USD 34,000 - 90,000; Part time

Benefits offered by this job

Remote work

Flexible schedule

Job summary

OpenTrain is seeking a Human Intelligence Interview Evaluation Expert to support AI training through structured elicitation, investigative questioning, and careful analysis of real-world interview interactions. You will assess how information is gathered and interpreted, identify signals, and produce clear reasoning for model learning.

The role is listed as entry level, but requires three to five or more years of professional interviewing, intelligence elicitation, investigative questioning,

Qualifications

• Three to five or more years of relevant professional experience
• Strong written and verbal English communication
• Ability to assess response reliability and justify analytical judgments
• Skill in interpreting tone, pacing, hesitation, gestures, and behavioral cues
• Ability to work respectfully with diverse populations or through interpreters
• Objectivity when scoring and classifying interview sessions

Responsibilities

• Conduct or assess structured elicitation and interview sessions
• Establish rapport and encourage open communication without pressure or coercion
• Interpret tone, pacing, hesitation, gestures, and other paralinguistic or nonverbal cues in real time
• Evaluate response reliability and confidence
• Identify emotional and motivational drivers and annotate relevant observations
• Document analytical reasoning in a clear, traceable format for readers
• Score or annotate sessions against detailed evaluation guidelines
• Maintain objectivity and consistency across cases

Skills

English proficiency

Interviewing

Analytical reasoning

Job description

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. It helps people discover specialized projects, build a credible profile, and apply to opportunities that can grow into a long-term AI training portfolio.

• Contractor and part-time opportunity
• Applicants based in the United States
• English-language work
• Pay range of $25-$65 per hour

About AI Training Work

AI training is the human side of building modern artificial intelligence. Contributors evaluate examples, classify information, and explain their judgments so AI systems can learn to interpret language, behavior, and real-world situations more effectively.

This work offers a way to apply specialized professional experience to cutting-edge technology, often with flexible schedules and remote access through a computer and internet connection.

The Role

OpenTrain is seeking a Human Intelligence Interview Evaluation Expert to support AI training through structured elicitation, investigative questioning, and careful analysis of real-world interview interactions. You will assess how information is gathered and interpreted, identify meaningful verbal and behavioral signals, and produce clear reasoning for model learning and downstream review.

The role is listed as entry level, but the requirements call for three to five or more years of professional interviewing, intelligence elicitation, investigative questioning, skilled negotiation, or related practical experience. The expected commitment is 20+ hours per week.

• Evaluation and classification of interview sessions
• US-based contractor opportunity
• 20+ hours per week
• $25-$65 per hour

What You'll Do

You will review or conduct structured interview and elicitation sessions involving varied subjects. Your work will combine objective observation, behavioral analysis, consistent rubric application, and written justification of analytical judgments.

• Conduct or assess structured elicitation and interview sessions
• Establish rapport and encourage open communication without pressure or coercion
• Interpret tone, pacing, hesitation, gestures, and other paralinguistic or nonverbal cues in real time
• Evaluate response consistency, reliability, potential evasiveness, and confidence
• Identify emotional and motivational drivers and annotate relevant observations
• Document analytical reasoning in a clear, traceable format for technical and non-specialist readers
• Score or annotate sessions against detailed evaluation guidelines
• Maintain objectivity and consistency across cases

Required Experience and Skills

You should bring substantial practical experience in professional interviewing, intelligence elicitation, investigative questioning, skilled negotiation, or a related field. Strong written and verbal English is essential, as is the ability to defend analytical conclusions clearly in writing.

The role requires respectful work with diverse populations or through interpreters, along with the ability to interpret verbal and nonverbal cues and apply detailed evaluation guidelines consistently.

• Three to five or more years of relevant professional experience
• Strong written and verbal English communication
• Ability to assess response reliability and justify analytical judgments
• Skill in interpreting tone, pacing, hesitation, gestures, and behavioral cues
• Ability to work respectfully with diverse populations or through interpreters
• Objectivity when scoring and classifying interview sessions

Helpful Background

Training in the PEACE model, cognitive interviewing, or a comparable recognized interviewing methodology is valuable. Relevant experience may come from military HUMINT, law enforcement interviewing, forensic interviewing, intelligence collection, professional negotiation, or formal behavioral analysis training.

Familiarity with data annotation, AI model evaluation, after-action reporting, or assessment reporting can also help you succeed.

• PEACE model or cognitive interviewing training
• Military HUMINT or intelligence collection
• Law enforcement or forensic interviewing
• Professional negotiation
• Formal behavioral analysis training
• Data annotation, AI evaluation, or assessment reporting

Why Build an AI Training Career with OpenTrain

OpenTrain gives contributors a place to develop a professional presence in the growing AI training and data-labeling industry. Your experience evaluating interviews can become part of a stronger portfolio while you discover projects that match your specialized skills.

By helping assess language, behavior, and reasoning, you contribute to the human feedback and evaluation processes behind increasingly capable AI systems.

• Apply professional interviewing expertise to AI development
• Build a credible AI training portfolio
• Discover specialized work aligned with your experience
• Create a foundation for continued growth in AI training