Remote AI Humanities Evaluation Specialist

YO AI Labs; San Jose (CA); Remote; USD 34,000 - 69,000; Full time

Job summary

YO AI Labs is seeking a Humanities Evaluation Specialist to support AI training through rigorous research, critical analysis, and well-documented reasoning. This is a contractor role with fully remote work, offering the flexibility to contribute to high-stakes evaluation tasks across disciplines.

Responsibilities include crafting challenging humanities questions, validating information with authoritative sources, and providing clear explanations with citations to uphold quality standards across

Qualifications

• Advanced academic background or professional experience in a humanities discipline.
• Strong analytical writing, close reading, and research skills.
• Ability to develop nuanced questions and clearly document reasoning and sources.
• Excellent written English and reliable independent work habits.

Responsibilities

• Create challenging humanities questions and high-quality answers.
• Research and verify information using authoritative sources and citations.
• Design prompts requiring deep interpretation and analytical reasoning.
• Evaluate AI-generated responses for accuracy, reasoning, and depth.
• Refine submissions based on reviewer feedback and quality standards.
• Provide clear, precise, and well-supported written explanations.

Skills

Research & Source Triangulation

Analytical Thinking

Humities Knowledge & Experience

Written Precision

Attention to Detail

Question & Prompt Development

Self-Direction & Reliability

Education

Advanced humanities degree or equivalent

Job description

YO AI Labs is seeking a Humanities Evaluation Specialist to support AI training through rigorous research, critical analysis, and well-documented reasoning. This is a contractor role with fully remote work, offering the flexibility to contribute to high-stakes evaluation tasks across disciplines.

Responsibilities include crafting challenging humanities questions, validating information with authoritative sources, and providing clear explanations with citations to uphold quality standards across