AI Research Evaluator & Subject-Matter Expert Remote

YO AI Labs; Los Angeles (CA); Remote; USD 83,000 - 165,000; Part time

Job summary

YO AI Labs seeks a PhD & Academic Expert to support AI research projects as a remote contractor. You will assess model outputs across technical and humanities disciplines and contribute expert prompts and critiques.

Strong written English, rigorous research methods, and a track record in peer review or academic writing are essential for high-quality evaluations and benchmarking AI systems. Ideal candidates hold a PhD and can explain complex ideas clearly to multidisciplinary teams.

Qualifications

• PhD required in a relevant field with strong research background.
• Experience in academic writing and peer review.
• Excellent written English and ability to communicate complex ideas clearly.
• Familiarity with evaluating AI outputs and research methodologies.

Responsibilities

• Evaluate AI responses for accuracy, depth, and reasoning.
• Create expert prompts, reference answers, and critiques.
• Identify errors, gaps, and weak reasoning in model outputs.
• Apply research methodologies and academic standards to assessments.
• Help establish quality benchmarks for AI systems.

Skills

Research & Research Methodology

Academic & Technical Writing

Critical Analysis

Data Analysis

Peer Review

Strong Written English

Education

PhD in a technical, STEM, English, literature, journalism, or related field

Job description

YO AI Labs seeks a PhD & Academic Expert to support AI research projects as a remote contractor. You will assess model outputs across technical and humanities disciplines and contribute expert prompts and critiques.

Strong written English, rigorous research methods, and a track record in peer review or academic writing are essential for high-quality evaluations and benchmarking AI systems. Ideal candidates hold a PhD and can explain complex ideas clearly to multidisciplinary teams.