Remote AI Research Evaluation Specialist (Part-Time)

micro1; United States; Remote; USD 83,000 - 165,000; Part time

Benefits offered by this job

Remote work worldwide

Part-time contractor (~15 hrs/wk)

Flexible start and onboarding

Job summary

micro1 is seeking a Research Evaluation Specialist to contribute expert insight for developing rigorous test material for advanced AI model evaluation. The role is remote worldwide and contractor-based, roughly 15 hours per week, with start-in-48-hours readiness and prompt onboarding.

Ideal candidates hold a Masters or PhD (or active candidacy) and have strong English writing, formal research experience, and a track record in AI-related tasks such as data labeling or model evaluation.

Qualifications

• Masters or PhD completed, active candidacy, or equivalent research experience in your domain.
• Demonstrated scholarly research and familiarity with primary literature.
• Exceptional analytical thinking and close attention to detail.
• Experience sourcing information from authoritative references.
• Proven ability to work independently in remote engagements.
• Ability to compose challenging, original, and methodologically sound questions.
• Prior AI training, data labeling, or model evaluation experience.

Responsibilities

• Create original, high-difficulty question-and-answer pairs at the cutting edge of your discipline to rigorously assess AI model capabilities.
• Source, verify, and thoroughly document answers using primary sources and authoritative references, including clear citations and reasoning.
• Design questions demanding advanced reasoning, methodological nuance, or synthesis across multiple sources, ensuring resistance to oversimplified or shortcut solutions.
• Test questions against AI systems, identify items that are not sufficiently challenging, and iteratively increase complexity while maintaining accuracy.
• Write each question and answer with high precision and clarity, eliminating ambiguity and supporting defensible responses.
• Integrate reviewer feedback and consistently uphold all project guidelines and quality standards throughout your deliverables.

Skills

AI research experience

Analytical thinking

Written English communication

Independent remote work

Question design

Education

Masters or PhD completed

Job description

micro1 is seeking a Research Evaluation Specialist to contribute expert insight for developing rigorous test material for advanced AI model evaluation. The role is remote worldwide and contractor-based, roughly 15 hours per week, with start-in-48-hours readiness and prompt onboarding.

Ideal candidates hold a Masters or PhD (or active candidacy) and have strong English writing, formal research experience, and a track record in AI-related tasks such as data labeling or model evaluation.