QA Deep Research Reviewer (Fully Remote)

Welo Data

United States

Remote

USD 28,000 - 50,000

Part time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Welo Data is an AI services company specializing in evaluating and improving AI-generated research outputs. The role focuses on reviewing long-form responses, including tables and citations, and scoring each criterion against detailed rubrics.

You will work as part of a freelance, remote team, calibrating decisions with QA guidelines and delivering concise, evidence-based rationales.

Qualifications

  • Native or near-native US English with ability to read long documents with tables and citations.
  • Experience evaluating against rubrics or guidelines (AI rating or QA).
  • Strong attention to evidence and detail.

Responsibilities

  • Evaluate long-form, AI-generated research outputs against detailed rubrics.
  • Read documents with tables and citations and judge each criterion on its own merits.
  • Write concise, evidence-based rationales that point to concrete evidence.
  • Review responses across US consumer topics and calibrate decisions with QA team.

Skills

US English (C2)
Reading long documents

Education

Bachelor's degree or equivalent experience

Job description

  • Evaluate long-form, AI-generated research outputs against detailed rubrics and guidelines.
  • Read documents that include tables and citations, and judge each criterion on its own merits.
  • Write concise, evidence-based rationales that point to concrete evidence.
What You'll Do:
  • Review research responses covering US consumer topics such as personal finance, healthcare, home repair, pets, and travel.
  • Score every criterion independently so that an overall impression doesn't sway individual judgments.
  • Follow guideline updates and calibrate decisions consistently with the QA team.
Must-Have Qualifications:
  • Native or near-native US English (C2) and ability to read long documents with tables and citations.
  • Bachelor's degree or equivalent experience in research, editing, fact-checking, or QA.
  • Proven experience with rubric- or guideline-based evaluation, such as AI rating or search quality rating.

Welo Data is an AI services company specializing in evaluating and improving AI-generated research outputs. The company operates as a freelance, remote team focused on quality and guideline-based evaluation.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Deep Research Reviewer (EN-US) (Fully Remote)
Deep Research Reviewer (EN-US) (Fully Remote)

Welo Data • United States

Remote
USD 32,000 - 45,000
Remote QA Deep Research Reviewer — Freelance, 15-20h/wk
Remote QA Deep Research Reviewer — Freelance, 15-20h/wk

Welo Data • United States

Remote
USD 32,000 - 45,000
Remote QA Research Reviewer (Freelance)
Remote QA Research Reviewer (Freelance)

AI Trainer HQ • United States

Remote
USD 32,000 - 45,000
Andromeda Shimu Deep Research Reviewer (EN-US)
Andromeda Shimu Deep Research Reviewer (EN-US)

AI Trainer HQ • United States

Remote
USD 32,000 - 45,000
Freelance QA Analyst (Remote)
Freelance QA Analyst (Remote)

Crewlia • United States

Remote
USD 34,000 - 55,000
Andromeda Shimu Deep Research Reviewer (EN-US)
Andromeda Shimu Deep Research Reviewer (EN-US)

Welocalize • United States

Remote
USD 28,000 - 48,000
Andromeda Shimu Deep Research Reviewer
Andromeda Shimu Deep Research Reviewer

Welocalize • United States

Remote
USD 30,000 - 34,000
Remote Freelance QA Analyst - AI Content Evaluator (Hourly)
Remote Freelance QA Analyst - AI Content Evaluator (Hourly)

Crewlia • United States

Remote
USD 34,000 - 55,000
Part-Time Deep Research QA Reviewer
Part-Time Deep Research QA Reviewer

Welocalize • United States

Remote
USD 30,000 - 34,000
Remote Data QA & Research Associate
Remote Data QA & Research Associate

Sotalent • United States

Remote
USD 19,000 - 28,000
Remote work
Flexible schedule
Training provided
+1