Remote AI Humanities Evaluator & Question Designer

YO AI Labs; Dallas (TX); Remote; USD 41,000 - 83,000; Part time

Job summary

YO AI Labs is seeking Humanities Evaluation Specialists for a remote contractor role to support AI training projects. Candidates will research, develop questions, and evaluate AI responses with emphasis on analytical reasoning and clear documentation.

No prior AI experience is required, but strong writing and critical analysis skills are essential. The project values precision and reliability in independent work and sources documentation.

Qualifications

• Advanced academic background or professional experience in a humanities discipline.
• Strong analytical writing, close reading, and research skills.
• Ability to develop nuanced questions and clearly document reasoning and sources.
• Excellent written English and reliable independent work habits.

Responsibilities

• Create challenging humanities questions and high-quality answers.
• Research and verify information using authoritative sources and citations.
• Design prompts requiring deep interpretation and analytical reasoning.
• Evaluate AI-generated responses for accuracy, reasoning, and depth.
• Refine submissions based on reviewer feedback and quality standards.
• Provide clear, precise, and well-supported written explanations.

Skills

Research & Source Triangulation

Analytical Thinking

humanities knowledge & experience

Written Precision

Attention to Detail

Question & Prompt Development

Self-Direction & Reliability

Education

Advanced humanities background

Job description

YO AI Labs is seeking Humanities Evaluation Specialists for a remote contractor role to support AI training projects. Candidates will research, develop questions, and evaluate AI responses with emphasis on analytical reasoning and clear documentation.

No prior AI experience is required, but strong writing and critical analysis skills are essential. The project values precision and reliability in independent work and sources documentation.