Remote Evaluation Specialist - AI Model Testing & Research

NEPSE Trading; United States; Remote; USD 28,000 - 62,000; Part time

Job summary

YO AI Labs seeks Evaluation Specialists (contractor) to craft challenging QA pairs and test AI models. Remote work with a focus on high-quality research, clear writing, and rigorous verification across sources.

Ideal candidates have strong English writing, critical thinking, and the ability to develop nuanced questions. Remote, contract-based role with fast onboarding and project-based tasks.

Qualifications

• Strong ability to conduct independent research and critically evaluate information from multiple sources.
• Excellent English writing skills, with precision and clarity.
• English fluency required; not necessarily your first language.
• Create nuanced, well-structured questions that test deep understanding and complex reasoning.
• Strong analytical thinking, problem-solving, and information synthesis.
• Self-motivated, reliable, and able to work remotely with accountability.
• AI training, model evaluation or content creation experience is a plus but not required.

Responsibilities

• Develop original, challenging question-and-answer pairs across diverse subjects.
• Conduct in-depth research and cross-verify information with multiple sources.
• Create multi-step questions that require analytical reasoning and synthesis.
• Test questions against AI models, analyze responses, and adjust difficulty.
• Document research with citations, evidence, and clear explanations.
• Revise content based on reviewer feedback while following guidelines.

Skills

Independent research

Analytical thinking

Critical thinking

Excellent English writing

Job description

YO AI Labs seeks Evaluation Specialists (contractor) to craft challenging QA pairs and test AI models. Remote work with a focus on high-quality research, clear writing, and rigorous verification across sources.

Ideal candidates have strong English writing, critical thinking, and the ability to develop nuanced questions. Remote, contract-based role with fast onboarding and project-based tasks.