Remote Humanities Evaluation & Prompt Design Specialist

YO AI Labs; Town of Schroeppel (NY); Remote; USD 55,000 - 83,000; Full time

Job summary

YO AI Labs is seeking a Humanities Evaluation Specialist for a remote contractor role to support AI training projects. You will craft challenging humanities questions, verify information with credible sources, and design prompts that require deep interpretation and reasoning.

You will evaluate AI responses for accuracy and depth, refine submissions based on reviewer feedback, and provide concise, well-supported explanations.

Qualifications

• Advanced humanities background and research experience.
• Strong analytical writing, close reading and source documentation.
• Ability to develop nuanced questions and clearly document reasoning.
• Excellent written English and reliable independent work habits.

Responsibilities

• Create challenging humanities questions and high-quality answers.
• Research and verify information using authoritative sources and citations.
• Design prompts requiring deep interpretation and analytical reasoning.
• Evaluate AI-generated responses for accuracy, reasoning, and depth.
• Refine submissions based on reviewer feedback and quality standards.
• Provide clear, precise, and well-supported written explanations.

Skills

Source Triangulation

Analytical Thinking

Humanities Knowledge

Written Precision

Attention to Detail

Prompt Development

Self-Direction

Education

Advanced humanities study or equivalent

Job description

YO AI Labs is seeking a Humanities Evaluation Specialist for a remote contractor role to support AI training projects. You will craft challenging humanities questions, verify information with credible sources, and design prompts that require deep interpretation and reasoning.

You will evaluate AI responses for accuracy and depth, refine submissions based on reviewer feedback, and provide concise, well-supported explanations.