AI Research Evaluator & Prompt Architect — Remote

YO AI Labs; Chicago (IL); Remote; USD 90,000 - 130,000; Full time

Job summary

YO AI Labs is seeking PhD and academic experts to support AI research projects in a remote capacity. You will use your subject-matter knowledge to evaluate and improve AI model responses across technical and humanities disciplines.

Responsibilities include evaluating responses, creating prompts and critiques, identifying errors, and applying rigorous academic methods to establish quality benchmarks for AI systems.

Qualifications

• PhD or equivalent research experience required.
• Experience with academic research, writing, or peer review.
• Excellent written English with ability to explain complex ideas clearly.
• Ability to apply rigorous research methodologies and standards.

Responsibilities

• Evaluate AI responses for accuracy, depth, and reasoning.
• Create expert prompts, reference answers, and critiques.
• Identify errors, gaps, and weak reasoning in outputs.
• Apply research methodologies and academic standards to evaluation.
• Help establish quality benchmarks for AI systems.

Skills

Research & Research Methodology

Academic & Technical Writing

Critical Analysis

Data Analysis

Peer Review

Strong Written English

Education

PhD in technical, STEM, English, literature, journalism, or related field

Job description

YO AI Labs is seeking PhD and academic experts to support AI research projects in a remote capacity. You will use your subject-matter knowledge to evaluate and improve AI model responses across technical and humanities disciplines.

Responsibilities include evaluating responses, creating prompts and critiques, identifying errors, and applying rigorous academic methods to establish quality benchmarks for AI systems.