Remote AI Research Evaluator (PhD Preferred)

YO AI Labs; San Francisco (CA); Remote; USD 80,000 - 120,000; Part time

Job summary

YO AI Labs is seeking PhD and academic experts to support AI research projects remotely. You will evaluate and improve AI model responses across technical and humanities disciplines, using your subject-matter expertise and rigorous research skills.

Responsibilities include producing expert prompts, reference answers, and critiques, identifying errors and gaps, and applying scientific standards to establish quality benchmarks for AI systems. Strong written English is essential.

Qualifications

• Must have PhD in a technical, STEM, English, literature, journalism, or related field.
• Experience with academic research, writing, or peer review is preferred.
• Excellent English communication skills are essential.
• Ability to explain complex concepts clearly to diverse audiences.

Responsibilities

• Evaluate AI responses for accuracy, depth, and reasoning.
• Create expert-level prompts, reference answers, and critiques.
• Identify errors, gaps, and weak reasoning.
• Apply research methodologies and academic standards.
• Help establish quality benchmarks for AI systems.

Skills

Research Methodology

Academic Writing

Critical Analysis

Data Analysis

Peer Review

Strong Written English

Education

PhD

Job description

YO AI Labs is seeking PhD and academic experts to support AI research projects remotely. You will evaluate and improve AI model responses across technical and humanities disciplines, using your subject-matter expertise and rigorous research skills.

Responsibilities include producing expert prompts, reference answers, and critiques, identifying errors and gaps, and applying scientific standards to establish quality benchmarks for AI systems. Strong written English is essential.