Remote AI Research Evaluator & Academic Expert

YO AI Labs; Palo Alto (CA); Remote; USD 90,000 - 120,000; Full time

Job summary

YO AI Labs seeks a PhD & Academic Expert to support AI research projects remotely. You will apply your subject-matter expertise to evaluate and improve model responses across technical and humanities disciplines.

You will develop expert prompts, reference answers, and critiques, while identifying errors, gaps, and weak reasoning using established research methodologies and academic standards.

Qualifications

• Must possess strong research methodologies and academic writing skills.
• Ability to evaluate AI outputs with rigorous analysis and clear criteria.
• Experience in peer review or scholarly critique is a plus.

Responsibilities

• Evaluate AI responses for accuracy, depth, and reasoning.
• Create expert prompts, reference answers, and critiques.
• Identify errors, gaps, and weak reasoning in outputs.
• Apply research methodologies and academic standards.
• Help establish quality benchmarks for AI systems.

Skills

Research & Research Methodology

Academic & Technical Writing

Critical Analysis

Data Analysis

Peer Review

Strong Written English

Education

PhD in a technical, STEM, English, literature, journalism, or related field

Job description

YO AI Labs seeks a PhD & Academic Expert to support AI research projects remotely. You will apply your subject-matter expertise to evaluate and improve model responses across technical and humanities disciplines.

You will develop expert prompts, reference answers, and critiques, while identifying errors, gaps, and weak reasoning using established research methodologies and academic standards.