AI Conversation Context Evaluator

OpenTrain AI, Inc.; United States; Hybrid; USD 55,000 - 110,000; Full time

Job summary

OpenTrain AI, Inc. is seeking contractors to evaluate conversations between people and AI models, focusing on whether enough context is gathered before recommendations are made. You will record structured findings and help keep assessments consistent.

The role involves reviewing real-world interpersonal conversations, identifying missing context, and suggesting clarifying questions. It is a three-week project with light but steady workload.

Qualifications

• 3 to 5 years in a relevant professional field such as social work, counseling, psychology, qualitative research or related areas.
• Ability to identify details that affect recommendations and note missed opportunities to clarify information.

Responsibilities

• Review conversations between people and AI models about everyday decisions.
• Identify missing context and suggest clarifying questions.
• Assess whether additional information could change AI recommendations.
• Separate decision-relevant details from descriptive information.

Skills

Interviewing

Qualitative analysis

Conversation analysis

User research

Thematic analysis

Qualitative coding

Education

Graduate degree or higher

Job description

OpenTrain AI, Inc. is seeking contractors to evaluate conversations between people and AI models, focusing on whether enough context is gathered before recommendations are made. You will record structured findings and help keep assessments consistent.

The role involves reviewing real-world interpersonal conversations, identifying missing context, and suggesting clarifying questions. It is a three-week project with light but steady workload.