Andromeda Shimu Deep Research Reviewer

Welo Data

Philippines

Remote

PHP 360,000 - 600,000

Full time

13 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Welo Data is seeking a QA Deep Research Reviewer to evaluate long-form AI-generated outputs against detailed rubrics. You’ll read documents with tables and citations, judge each criterion independently, and write concise, evidence-based rationales to help improve AI research tools.

Ideal candidates have native US English skills, familiarity with US consumer topics, and a background in research, editing, or QA. Expect ~15–20 hours weekly with reliable internet, a laptop, and a remote work setup.

Qualifications

  • Native or near-native US English reading ability with clear long documents containing tables and citations.
  • Familiarity with US consumer topics: personal finance, taxes, healthcare, home repair, pets, travel planning.
  • Bachelor's degree or equivalent in research, editing, fact-checking, teaching, or QA.
  • Proven experience with rubric-/guideline-based evaluation (AI/LLM rating, content moderation, etc.).
  • Ability to write concise rationales that cite evidence.

Responsibilities

  • Review long-form AI-generated research outputs against rubrics and guidelines.
  • Evaluate each response against rubric criteria, scoring each independently.
  • Check claims, tables, and citations for accuracy and cite primary sources.
  • Write short, specific rationales (1–3 sentences) with concrete evidence.
  • Follow guideline updates and calibrate decisions with the QA team.

Skills

US English (C2)
Editorial QA
Research & fact-checking
Rubric-based evaluation
Rationale writing

Education

Bachelor's degree

Job description

About The Role

We're looking for a QA Deep Research Reviewer to evaluate long-form, AI-generated research outputs against detailed rubrics and guidelines. You'll read documents that include tables and citations, judge each criterion on its own merits, and write clear, evidence-based rationales that help us improve the quality of AI research tools. This role suits someone with a sharp editorial eye, a fact-checker's instincts, and the discipline to apply guidelines consistently

What You'll Do
  • Review long form research responses covering US consumer topics such as personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
  • Evaluate each response against rubric criteria, scoring every criterion independently so that an overall impression doesn't sway individual judgments
  • Check claims, tables, and citations for accuracy, and distinguish primary sources from low-quality or content-farm pages
  • Write short, specific rationales (1-3 sentences) that point to concrete evidence
  • Follow guideline updates and calibrate your decisions consistently with the QA team.
Must-Have Qualifications
  • Native or near-native US English (C2), with the ability to read long documents containing tables and citations
  • Familiarity with US consumer topics: personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
  • Bachelor's degree, or equivalent experience in research, editing, fact-checking, teaching, or QA
  • Proven experience with rubric- or guideline based evaluation (e.g., AI/LLM rating, search quality rating, content moderation, grading, or editorial QA)
  • Ability to write concise rationales that cite evidence
  • Ability to judge each criterion independently, without letting an overall impression influence the call
  • Reliable availability of 15-20 hours per week, with a stable internet connection and a laptop or desktop computer.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Andromeda Shimu Deep Research Reviewer
Andromeda Shimu Deep Research Reviewer

Welo Global • Philippines

Hybrid
MXN 178,000 - 203,000
QA Deep Research Reviewer — US Topics & Fact-Check
QA Deep Research Reviewer — US Topics & Fact-Check

Welo Data • Philippines

Remote
PHP 360,000 - 600,000
Remote QA Research Reviewer (Part-Time, 15-20h/wk)
Remote QA Research Reviewer (Part-Time, 15-20h/wk)

Welo Global • Philippines

Hybrid
MXN 178,000 - 203,000
Andromeda Shimu Deep Research Reviewer
Andromeda Shimu Deep Research Reviewer

Softechub • Philippines

Remote
PHP 507,000 - 722,000
Remote AI Research QA Reviewer
Remote AI Research QA Reviewer

Softechub • Philippines

Remote
PHP 507,000 - 722,000
QA / AI Evaluation & Research Engineer
QA / AI Evaluation & Research Engineer

Datamatics Careers- Philippines • Pasig

On-site
PHP 1,200,000 - 2,100,000
Market Research Expert
Market Research Expert

SME Careers • Metro Manila

Remote
PHP 2,163,000 - 4,327,000
PR & Communications Expert
PR & Communications Expert

SME Careers • Metro Manila

Remote
PHP 2,163,000 - 3,894,000
Quality Analyst
Quality Analyst

Everglow AI • Pasig

On-site
PHP 446,000 - 781,000
Contract Review Expert
Contract Review Expert

SME Careers • Metro Manila

Remote
PHP 2,166,000 - 5,198,000
Remote work
Top locations