AI Research Quality Evaluator — Remote (PhD Expert)

YO AI Labs; California City (CA); Remote; USD 96,000 - 165,000; Full time

Job summary

YO AI Labs seeks PhD and academic experts to support AI research projects. You will evaluate and improve AI model responses across technical and humanities disciplines using your subject-matter expertise and research skills.

This remote contractor role focuses on identifying errors, gaps, and weak reasoning, and on creating expert prompts, reference answers, and critiques to help raise system quality.

Qualifications

• PhD-level research experience and strong analytical writing ability.
• Experience applying research methodologies and academic standards.
• Ability to evaluate AI outputs for accuracy and depth.
• Excellent written English with clear communication.

Responsibilities

• Evaluate AI responses for accuracy, depth, and reasoning.
• Create expert-level prompts, reference answers, and critiques.
• Identify errors, gaps, and weak reasoning in outputs.
• Apply research methodologies and academic standards.
• Help establish quality benchmarks for AI systems.

Skills

Research & Research Methodology

Academic & Technical Writing

Critical Analysis

Data Analysis

Peer Review

Strong Written English

Education

PhD in a technical, STEM, English, literature, journalism, or related field

Job description

YO AI Labs seeks PhD and academic experts to support AI research projects. You will evaluate and improve AI model responses across technical and humanities disciplines using your subject-matter expertise and research skills.

This remote contractor role focuses on identifying errors, gaps, and weak reasoning, and on creating expert prompts, reference answers, and critiques to help raise system quality.