AI Research Evaluator & Prompt Expert (Remote)

YO AI Labs; Phoenix (AZ); Remote; USD 83,000 - 165,000; Part time

Job summary

YO AI Labs is seeking PhD and academic experts to support AI research projects, working remotely. You will evaluate model responses across technical and humanities disciplines and help improve accuracy through expert prompts, reference answers, and critiques.

Responsibilities include identifying errors, applying rigorous research methodologies, and helping set quality benchmarks for AI systems. Strong written English and peer-review experience are highly valued.

Qualifications

• PhD in a technical, STEM, English, literature, journalism, or related field.
• Experience with academic research, writing, or peer review.
• Excellent English communication skills.
• Ability to explain complex concepts clearly.
• Candidates based in English-speaking countries preferred.

Responsibilities

• Evaluate AI responses for accuracy, depth, and reasoning.
• Create expert-level prompts, reference answers, and critiques.
• Identify errors, gaps, and weak reasoning.
• Apply research methodologies and academic standards.
• Help establish quality benchmarks for AI systems.

Skills

Research Methods

Academic Writing

Critical Analysis

Data Analysis

Peer Review

Written English

Education

PhD in STEM/English/related

Job description

YO AI Labs is seeking PhD and academic experts to support AI research projects, working remotely. You will evaluate model responses across technical and humanities disciplines and help improve accuracy through expert prompts, reference answers, and critiques.

Responsibilities include identifying errors, applying rigorous research methodologies, and helping set quality benchmarks for AI systems. Strong written English and peer-review experience are highly valued.