Humanities Evaluation Specialist

micro1; United States; Remote; USD 34,000 - 69,000; Part time

Job summary

micro1 is seeking a Humanities Evaluation Specialist for a remote contractor role focused on creating high-quality QA prompts and reasoning for AI models. You will leverage advanced humanities knowledge to craft challenging questions, provide authoritative citations, and design prompts that require interpretation and critical analysis.

You will verify sources, document reasoning clearly, and iterate on submissions according to project guidelines.

Qualifications

• Advanced academic background in humanities disciplines such as history, literature, philosophy, linguistics, classics, art history, or journalism.
• Exceptional analytical writing and close-reading abilities.
• Demonstrated meticulousness and ability to document reasoning and sources clearly.
• Experience producing challenging questions that probe understanding beyond surface facts.

Responsibilities

• Develop original, high-difficulty question-and-answer pairs to challenge AI models on interpretation, argument, context, and analytical reasoning in humanities.
• Research, verify, and cite credible sources to support answers and reasoning.
• Design prompts that require deep analytical or interpretive insights rather than recall.
• Test questions against AI models and iterate to increase difficulty and clarity.
• Write with precision, crafting unambiguous questions and well-supported answers.
• Incorporate reviewer feedback to refine submissions and align with guidelines.

Skills

Advanced humanities background

Analytical writing

Close-reading

Question formulation

Meticulousness

Documentation of reasoning

Remote work discipline

Education

Advanced humanities degree

Job description

Role Title and Details

Humanities Evaluation Specialist

Role Type: Contractor

Location: Remote

micro1 is engaging Humanities Evaluation Specialists to contribute to a customer's innovative AI project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Scope of Work

• Develop original, high-difficulty question-and-answer pairs that challenge advanced AI models on interpretation, argument, context, and analytical reasoning within the humanities.
• Research, verify, and provide authoritative citations to support accurate answers and reasoning, referencing primary texts and reputable sources.
• Design prompts that demand deep analytical or interpretive insight rather than surface-level recall.
• Test questions against AI models, iterating to increase difficulty and sharpen clarity while ensuring correctness.
• Write with precision and attention to detail, crafting unambiguous questions and well-supported answers.
• Apply feedback from reviewers to refine submissions and maintain alignment with project guidelines and quality standards.

Preferred Qualifications

• Advanced academic background or professional experience in a humanities discipline such as history, literature, philosophy, linguistics, classics, art history, or journalism.
• Exceptional analytical writing, close-reading, and question formulation skills.
• Demonstrated meticulousness and ability to document reasoning and sources clearly.
• Experience producing challenging, nuanced questions that probe for understanding beyond surface-level facts.
• Self-directed and highly reliable in delivering project tasks independently within a remote context.
• Familiarity with AI model evaluation or training is a plus, though not required.

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.

Originally posted on Himalayas