Remote PhD & Academic Expert: AI Research Evaluator

YO AI Labs; Illinois City (IL); Remote; USD 90,000 - 150,000; Part time

Job summary

YO AI Labs seeks PhD and academic experts to support AI research projects. You will evaluate model responses across technical and humanities disciplines, and craft expert prompts, reference answers, and critiques.

You will identify errors, gaps, and weak reasoning and apply rigorous research methodologies and standards. This contractor role emphasizes high-quality, academic-level analysis and the development of benchmarks to advance AI system performance.

Qualifications

• Experience designing and applying research methodologies for AI-related evaluation.
• Ability to produce clear, well-structured academic writing and critiques.
• Strong analytical skills for assessing model outputs and reasoning.

Responsibilities

• Evaluate AI responses for accuracy, depth, and reasoning.
• Create expert prompts, reference answers, and critiques.
• Identify errors, gaps, and weak reasoning in model outputs.
• Apply established research methodologies and academic standards.
• Help establish quality benchmarks for AI systems.

Skills

Research Methods

Academic Writing

Critical Analysis

Data Analysis

Peer Review

Written English

Education

PhD in STEM/English/related

Job description

YO AI Labs seeks PhD and academic experts to support AI research projects. You will evaluate model responses across technical and humanities disciplines, and craft expert prompts, reference answers, and critiques.

You will identify errors, gaps, and weak reasoning and apply rigorous research methodologies and standards. This contractor role emphasizes high-quality, academic-level analysis and the development of benchmarks to advance AI system performance.