Remote AI Evaluation Scientist (PhD)

RemoteJobsOne; Dubai; Remote; AED 202,000 - 455,000; Part time

Job summary

RemoteJobsOne in the United Arab Emirates invites PhD-level researchers to join as Research Evaluation Specialists on a remote, contractor basis. You will develop high-difficulty questions and ensure quality with primary sources, citations, and rigorous reasoning.

Ideal candidates have a PhD or active candidacy, strong English writing, and a track record in scholarly research. You will work independently, delivering expert-level content for AI model evaluation from a fully remote setup.

Qualifications

• PhD completed or in progress in your domain.
• Demonstrated track record of scholarly research and familiarity with primary literature.
• Exceptional analytical thinking and strong written English communication.

Responsibilities

• Create original high-difficulty question-and-answer pairs to assess AI model capabilities.
• Source verify and document answers with primary sources and citations.
• Design questions requiring advanced reasoning and cross-source synthesis.
• Test questions against AI systems and iteratively increase complexity while maintaining accuracy.
• Write questions and answers with precision and clarity; remove ambiguity.
• Incorporate reviewer feedback and uphold project guidelines and quality standards.

Skills

Analytical thinking

Written English

Independent work

Education

PhD completed or in progress

Job description

RemoteJobsOne in the United Arab Emirates invites PhD-level researchers to join as Research Evaluation Specialists on a remote, contractor basis. You will develop high-difficulty questions and ensure quality with primary sources, citations, and rigorous reasoning.

Ideal candidates have a PhD or active candidacy, strong English writing, and a track record in scholarly research. You will work independently, delivering expert-level content for AI model evaluation from a fully remote setup.