Remote AI Research Evaluation Specialist

micro1; United States; Remote; USD 55,000 - 96,000; Full time

Job summary

micro1 is seeking a Research Evaluation Specialist (PhD or Masters) to develop rigorous test material for evaluating advanced AI models. This remote, worldwide contractor role involves creating challenging Q&A and sourcing authoritative references to support answers and reasoning.

You will design questions with high precision, verify answers with primary sources, and iteratively increase task difficulty while maintaining accuracy. Strong written English and AI training experience are required.

Qualifications

• Must have Masters/PhD or equivalent research experience.
• Strong analytical thinking and attention to detail.
• Excellent written English communication.
• Experience sourcing from authoritative references.
• Proven ability to work independently in remote engagements.
• Experience with AI training, data labeling, or model evaluation.

Responsibilities

• Create original, high-difficulty Q&A pairs at the cutting edge of your discipline.
• Source, verify, and document answers with primary sources and citations.
• Design questions demanding advanced reasoning and cross-source synthesis.
• Test questions against AI systems and iteratively increase complexity.
• Write each question and answer with high precision and clarity.
• Integrate reviewer feedback and uphold project guidelines and quality standards.

Skills

Academic research

Analytical thinking

Technical writing

English proficiency

Remote work

Question design

AI training / model evaluation

Education

Masters or PhD in relevant field

Active PhD candidacy or equivalent research experience

Job description

micro1 is seeking a Research Evaluation Specialist (PhD or Masters) to develop rigorous test material for evaluating advanced AI models. This remote, worldwide contractor role involves creating challenging Q&A and sourcing authoritative references to support answers and reasoning.

You will design questions with high precision, verify answers with primary sources, and iteratively increase task difficulty while maintaining accuracy. Strong written English and AI training experience are required.