Remote AI Research Evaluation Specialist (Contract, ~15h/wk)

Zekai; United States; Remoto; USD 55.000 - 83.000; Part-time

Descrizione del lavoro

Zekai is seeking a Research Evaluation Specialist (PhD or Masters) for a remote, world-wide contractor role (~15 hours per week). You will craft high-difficulty QA pairs to rigorously evaluate AI models, source primary references, and document reasoning with citations.

Strong background in AI training or evaluation is required, along with excellent English writing and independent remote work capability. Preferred applicants hold an advanced degree and have a proven track record in scholarly

Competenze

• Masters or PhD completed or active candidacy in a research discipline.
• Strong ability to source and triangulate information from primary literature.
• Excellent written communication in English and meticulousness.

Mansioni

• Create high-difficulty Q&A pairs to test AI model evaluation.
• Source, verify, and document answers with citations and reasoning.
• Design questions requiring advanced reasoning and cross-source synthesis.
• Test items in AI systems and iteratively raise complexity.
• Write questions and answers with precision and clarity, reducing ambiguity.

Conoscenze

Research expertise

Analytical thinking

English writing

Source primary literature

Independent remote work

Formazione

Masters or PhD completed

Active candidacy or equivalent research experience

Descrizione del lavoro

Zekai is seeking a Research Evaluation Specialist (PhD or Masters) for a remote, world-wide contractor role (~15 hours per week). You will craft high-difficulty QA pairs to rigorously evaluate AI models, source primary references, and document reasoning with citations.

Strong background in AI training or evaluation is required, along with excellent English writing and independent remote work capability. Preferred applicants hold an advanced degree and have a proven track record in scholarly