Research Evaluation Specialist

RemoteJobsOne; Dubai; Remote; AED 202,000 - 455,000; Part time

Job summary

RemoteJobsOne in the United Arab Emirates invites PhD-level researchers to join as Research Evaluation Specialists on a remote, contractor basis. You will develop high-difficulty questions and ensure quality with primary sources, citations, and rigorous reasoning.

Ideal candidates have a PhD or active candidacy, strong English writing, and a track record in scholarly research. You will work independently, delivering expert-level content for AI model evaluation from a fully remote setup.

Qualifications

• PhD completed or in progress in your domain.
• Demonstrated track record of scholarly research and familiarity with primary literature.
• Exceptional analytical thinking and strong written English communication.

Responsibilities

• Create original high-difficulty question-and-answer pairs to assess AI model capabilities.
• Source verify and document answers with primary sources and citations.
• Design questions requiring advanced reasoning and cross-source synthesis.
• Test questions against AI systems and iteratively increase complexity while maintaining accuracy.
• Write questions and answers with precision and clarity; remove ambiguity.
• Incorporate reviewer feedback and uphold project guidelines and quality standards.

Skills

Analytical thinking

Written English

Independent work

Education

PhD completed or in progress

Job description

IMPORTANT: after you apply please check your email. We send you a link to complete your application it is not considered until that last step is done. If you do not see it check your spam folder.

This is a fully remote position open to candidates based in United Arab Emirates.

Pay: $40$90/hr

Role Title: Research Evaluation Specialist (PhD / Researcher / Professor)

Role Type: Contractor

Location: Remote

We are engaging Research Evaluation Specialists (PhD / Researcher / Professor) to contribute expert insight in developing rigorous test material for advanced AI model evaluation as part of a customers this role youll apply your expertise to help train next-generation AI systems. Your work will shape how models learn reason and perform through high-quality real-world input. No prior experience in AI is required your domain knowledge is what matters.

Scope of Work

• Create original high-difficulty question-and-answer pairs at the cutting edge of your discipline to rigorously assess AI model capabilities.
• Source verify and thoroughly document answers using primary sources and authoritative references including clear citations and reasoning.
• Design questions demanding advanced reasoning methodological nuance or synthesis across multiple sources ensuring resistance to oversimplified or shortcut solutions.
• Test questions against AI systems identify items that are not sufficiently challenging and iteratively increase complexity while maintaining accuracy.
• Write each question and answer with high precision and clarity eliminating ambiguity and supporting defensible responses.
• Integrate reviewer feedback and consistently uphold all project guidelines and quality standards throughout your deliverables.

Preferred Qualifications

• PhD completed active candidacy or equivalent research experience as a specialist researcher or professor in your domain.
• Demonstrated track record of scholarly research in-depth subject matter expertise and familiarity with primary literature.
• Exceptional analytical thinking close attention to detail and strong written communication skills in English.
• Experience sourcing and triangulating information from authoritative references.
• Proven self-direction and reliability in delivering expert-level work independently within remote engagements.
• Skill in composing challenging original and methodologically sound questions.
• Experience in AI training or evaluation is advantageous but not required.

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the experts experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected we expect you to start your first tasks within 2448 hours of completing onboarding.