Remote Humanities Evaluator & Prompt Designer

YO AI Labs; New York (NY); Remote; USD 30,000 - 55,000; Full time

Job summary

YO AI Labs is seeking Humanities Evaluation Specialists for a remote contract to support an AI training project. You will research, analyze, and craft challenging humanities questions with high-quality answers, while ensuring clear documentation of reasoning and sources.

No prior AI experience is required. You will design prompts that require deep interpretation and evaluate AI responses for accuracy and depth, refining submissions based on reviewer feedback to meet quality standards.

Qualifications

• Advanced academic background in a humanities discipline.
• Strong analytical writing, close reading, and research skills.
• Ability to develop nuanced questions and clearly document reasoning and sources.
• Excellent written English and reliable independent work habits.

Responsibilities

• Create challenging humanities questions and high-quality answers.
• Research and verify information using authoritative sources and citations.
• Design prompts requiring deep interpretation and analytical reasoning.
• Evaluate AI-generated responses for accuracy, reasoning, and depth.
• Refine submissions based on reviewer feedback and quality standards.
• Provide clear, precise, and well-supported written explanations.

Skills

Research & Source Triangulation

Analytical Thinking

Humanities Knowledge & Experience

Written Precision

Attention to Detail

Question & Prompt Development

Self-Direction & Reliability

Education

Advanced humanities degree

Job description

YO AI Labs is seeking Humanities Evaluation Specialists for a remote contract to support an AI training project. You will research, analyze, and craft challenging humanities questions with high-quality answers, while ensuring clear documentation of reasoning and sources.

No prior AI experience is required. You will design prompts that require deep interpretation and evaluate AI responses for accuracy and depth, refining submissions based on reviewer feedback to meet quality standards.