Remote AI Evaluation Specialist — Part-Time Team Management

OpenTrain AI, Inc.; United States; Remote; USD 28,000 - 55,000; Part time

Job summary

OpenTrain AI, Inc. is hiring for a worldwide remote, part-time contract role focused on creating challenging prompts and evaluating language model responses.

Candidates should bring strong English writing, analytic thinking, and team-management experience to assess accuracy, reasoning, and usefulness of model outputs. The role requires leadership and performance management skills, workforce planning, and operational execution to judge AI handling of management topics, with a flexible, remote,

Qualifications

• Master's degree or higher required.
• At least three years of professional, research, or teaching experience.

Responsibilities

• Create complex prompts that test large language model capabilities.
• Evaluate AI-generated responses for factual accuracy, reasoning, relevance, and overall quality.
• Find factual errors, logical inconsistencies, knowledge gaps, and other weaknesses.
• Design challenging test cases and edge cases that reveal model limitations.
• Write clear, detailed, evidence-based feedback to support measurable model improvement.

Skills

Analytical thinking

Critical thinking

Attention to detail

Feedback writing

Education

Master's degree or higher

Tools

Prompt engineering

AI evaluation

Model testing

Job description

OpenTrain AI, Inc. is hiring for a worldwide remote, part-time contract role focused on creating challenging prompts and evaluating language model responses.

Candidates should bring strong English writing, analytic thinking, and team-management experience to assess accuracy, reasoning, and usefulness of model outputs. The role requires leadership and performance management skills, workforce planning, and operational execution to judge AI handling of management topics, with a flexible, remote,