LLM Analytical Quality Analyst

OpenTrain AI, Inc.

United States

Remote

USD 21,000 - 39,000

Part time

35 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

OpenTrain AI, Inc. is seeking a part-time, 100% remote contractor to review and improve language model outputs. You will test analytical reasoning, research claims online, and provide precise annotations and feedback to guide AI training.

The role requires fluent English and a commitment of 20 or more hours per week in a fully remote setup. The position emphasizes clear writing, data interpretation, and careful attention to text accuracy and formatting.

Qualifications

  • Fluent English reading and writing required.
  • Bachelor's degree or current undergrad in engineering, literature, journalism, communications, arts, statistics or related field is helpful.
  • Quality assurance, data annotation, content review, professional writing, editing, translation, or research analysis experience is helpful.

Responsibilities

  • Review large language model answers and write precise feedback.
  • Create and evaluate analytical scenarios to reveal model weaknesses.
  • Read and summarize content and divide longer materials into clear logical blocks.
  • Research information online and validate claims in written content.
  • Review model responses, identify errors, and provide correct explanations.

Skills

Research
Analysis
Data interpretation
Logical reasoning
Clear writing
Attention to detail
Fluent English

Education

Bachelor's degree or current undergrad study in engineering, literature, journalism, communications, arts, statistics

Tools

Excel
Google Suite

Job description

Review large language model answers, test analytical reasoning, research claims, and write clear feedback for AI training. This remote contract role is open worldwide, requires fluent English, and takes 20 or more hours per week.

100% Remote

Contract, part-time

Engagement

Remote

Location

Oct 20, 2026

Posted

The Work

You will help improve large language models by creating and evaluating analytical scenarios, reviewing model answers, checking claims through online research, and writing precise annotations. The work combines language comprehension, logical reasoning, data interpretation, content review, and structured feedback.

  • Answer questions involving data interpretation, trends, logical reasoning, basic arithmetic, and quantitative constraints.
  • Create scenarios that reveal weaknesses in model reasoning.
  • Read and summarize content, then divide larger materials into clear logical blocks.
  • Research information online and validate claims in written content.
  • Review model responses, identify errors, and provide correct answers with clear explanations.
  • Write constructive feedback focused on accuracy, reasoning, and formatting.
What It Pays and Takes

This is a part-time contractor role with a commitment of 20 or more hours per week. No pay rate is provided in the role details.

  • Language: Fluent English reading and writing.
  • Work setup: Reliable desktop or laptop and internet connection.
  • Required skills: Research, analysis, data interpretation, logical reasoning, clear writing, and careful attention to text accuracy and formatting.
  • Work style: Ability to work independently in a remote setting.
  • Helpful background: A bachelor's degree or current undergraduate study in engineering, literature, journalism, communications, arts, statistics, or a related field.
  • Helpful experience: Quality assurance, data annotation, content review, professional writing, editing, translation, or research analysis.
  • Useful tools and knowledge: Excel, Google Suite, logical reasoning, and basic arithmetic.
How It Works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI Training Work

AI training is the human work behind modern artificial intelligence, including writing examples, reviewing model answers, and explaining why one response is better than another. People with strong reasoning, language, research, or subject knowledge help make AI systems more accurate and useful.

Requirements
  • Experience: Entry level
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

LLM Response Evaluation Annotator
LLM Response Evaluation Annotator

OpenTrain AI, Inc. • United States

Remote
USD 55,000 - 103,000
Tooling Engineer Business Analysis AI Evaluation
Tooling Engineer Business Analysis AI Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 41,000 - 83,000
Remote work
Per-task payment
Data Science Methodology SME
Data Science Methodology SME

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 138,000
Remote Part-Time Analytical Quality Specialist
Remote Part-Time Analytical Quality Specialist

OpenTrain AI, Inc. • United States

Remote
USD 21,000 - 39,000
AI QA Trainer - LLM Evaluation - Freelance Project
AI QA Trainer - LLM Evaluation - Freelance Project

Meridial • United States

On-site
USD 8,265 - 89,544
Secure computer and high-speed internet required
English Language Expert
English Language Expert

SME Careers • San Jose (CA)

Remote
USD 28,000 - 83,000
English Language Expert
English Language Expert

SME Careers • Baltimore (MD)

Remote
USD 34,000 - 55,000
English Language Expert
English Language Expert

SME Careers • San Antonio (TX)

Remote
USD 34,000 - 55,000
English Language Expert
English Language Expert

SME Careers • Cedar Rapids (IA)

Remote
USD 34,000 - 55,000
AI QA Trainer - LLM Evaluation - Freelance Project
AI QA Trainer - LLM Evaluation - Freelance Project

Agency • United States

Remote
USD 8,300 - 90,000