AI Question and Answer Evaluation Specialist

OpenTrain AI, Inc.; United States; Remote; USD 28.000 - 83.000; Teilzeit

Zusammenfassung

OpenTrain AI, Inc. is seeking an AI Question and Answer Evaluation Specialist to create research-backed questions and answers, test AI model responses, and improve evaluation content remotely for an hourly-equivalent, task-based compensation model.

This entry-level, part-time role emphasizes high-quality written English, independent research, and careful analysis. The ideal candidate will craft nuanced questions, cite sources, and revise content based on reviewer feedback while maintaining

Qualifikationen

• Fluent written English with precise wording, strong structure, and close attention to detail.
• Ability to conduct independent research across multiple sources.
• Ability to write nuanced questions that separate superficial answers from well-reasoned responses.
• Self-direction, reliability and accountability in remote project work.

Aufgaben

• Create original questions that test deep understanding, analysis, and synthesis.
• Research answers across multiple sources, compare evidence, and add clear citations.
• Write accurate, well-structured answers with logical explanations.
• Test questions against AI models and review the quality of responses.
• Adjust question difficulty when needed and revise work using reviewer feedback.
• Follow project guidelines and quality standards.

Kenntnisse

Research

Writing

Attention to detail

English proficiency

Self-direction

Jobbeschreibung

AI Question and Answer Evaluation Specialist

Create research-backed questions and answers, test AI model responses, and improve evaluation content remotely for $20 to $60 per hour equivalent, paid per task.

$20-$60/hr

equivalent, paid per accepted task

Compensation

Contract, part-time

Engagement

Remote

Location

Oct 20, 2026

Posted

Open in 51 countries

United States

• Algeria
• Argentina
• Austria
• Bahrain
• Bangladesh
• Belgium
• Brazil
• Canada
• Chile
• Colombia
• Denmark
• Egypt
• France
• Germany
• Ghana
• Greece
• India
• Indonesia
• Italy
• Japan
• Jordan
• Kazakhstan
• Kenya
• Kuwait
• Kyrgyzstan
• Lebanon
• Malaysia
• Mexico
• Morocco
• Netherlands
• Nigeria
• Oman
• Pakistan
• Palestine
• Peru
• Philippines
• Portugal
• Qatar
• Saudi Arabia
• Singapore
• South Africa
• Spain
• Sri Lanka
• Switzerland
• Taiwan
• Thailand
• Tunisia
• United Arab Emirates
• United States
• Uzbekistan
• Vietnam

The work

You will create question-and-answer content that tests what AI systems know, how they reason, and whether they can combine information from multiple sources. You will research answers carefully, explain your reasoning, and improve content based on feedback.

• Write original questions that test deep understanding, analysis, and synthesis.
• Research answers across multiple sources, compare evidence, and add clear citations.
• Write accurate, well-structured answers with logical explanations.
• Test questions against AI models and review the quality of their responses.
• Adjust question difficulty when needed and revise work using reviewer feedback.
• Follow project guidelines and quality standards.

What it pays and takes

This is a remote, part-time contractor role with output-based compensation. Payment is tied to tasks that meet the project specifications, and the role is listed as entry level.

• $20 to $60 per hour equivalent, paid per task that meets the project specifications.
• Less than 20 hours per week.
• Open to candidates in the United Arab Emirates, Argentina, Austria, Bangladesh, Belgium, Bahrain, Brazil, Canada, Switzerland, Chile, Colombia, Germany, Denmark, Algeria, Egypt, Spain, France, Ghana, Greece, Indonesia, India, Italy, and Jordan.
• Also open to candidates in Japan, Kenya, Kyrgyzstan, Kuwait, Kazakhstan, Lebanon, Sri Lanka, Morocco, Mexico, Malaysia, Nigeria, the Netherlands, Oman, Peru, the Philippines, Pakistan, Palestine, Portugal, Qatar, Saudi Arabia, Singapore, Thailand, Tunisia, Taiwan, the United States, Uzbekistan, Vietnam, and South Africa.
• Fluent written English with precise wording, strong structure, and close attention to detail.
• Ability to conduct independent research and assess information from multiple sources.
• Ability to write nuanced questions that separate superficial answers from well-reasoned responses.
• Self-direction, reliability, and accountability in remote project work.
• Previous AI training, model evaluation, or content creation experience is helpful but not required.
• People from any academic or professional background may be considered when they can show strong research and writing skills.
• The project expects a prompt start after onboarding.

About AI training work

AI training is the human work behind systems that learn from examples, including writing questions, rating answers, and checking whether model responses are accurate and well reasoned. People with strong research, writing, or subject knowledge help make these systems more useful and reliable.

Requirements

• Experience: Entry level