LLM Content Evaluation Analyst

OpenTrain AI, Inc.; United States; Remote; USD 62,000 - 124,000; Part time

Benefits offered by this job

Remote work

Job summary

OpenTrain AI, Inc. seeks entry-level writers for a part-time, fully remote contract role open worldwide. The position requires 20+ hours per week and fluent English reading and writing.

You will evaluate AI-generated content and model outputs, perform online research, and provide clear feedback to improve accuracy. Responsibilities include summarizing, annotating, and explaining decisions to reveal model reasoning.

Qualifications

• Fluent English reading and writing required.
• Strong research, analytical and logical reasoning abilities.
• Basic arithmetic skills helpful.

Responsibilities

• Evaluate AI-generated content and model outputs; improve accuracy.
• Perform online research and provide clear feedback to refine responses.
• Read, summarize, and annotate to highlight mistakes and suggest improvements.

Skills

Fluent English

Research skills

Analytical reasoning

Arithmetic basics

Tools

Excel

Google Suite

Job description

Review written content and large language model answers, research claims, solve analytical problems, and explain corrections. This entry-level contract role is open worldwide for English-language writers available 20 or more hours per week.

100% Remote

Contract, part-time

Engagement

Remote

Location

Oct 24, 2026

Posted

The Work

You will evaluate written content and large language model outputs to help improve how AI answers questions. The work combines careful reading, online research, logical reasoning, text accuracy checks, and clear written feedback.

• Read, summarize, and divide large content into smaller logical sections.
• Answer analytical questions and create scenarios that reveal weaknesses in model reasoning.
• Research information online and validate claims made in written content.
• Correct inaccurate model answers and explain the reasoning behind accurate answers.
• Analyze examples such as sales trends across locations and rule-based logic problems.
• Add detailed annotations and constructive feedback while checking text accuracy and formatting.

What the Role Requires

This is an entry-level, part-time contractor role. Experience with quality assurance, data annotation, content review, or professional writing is useful, as is study in an analytical, writing, communications, or technical field.

• Availability of 20 or more hours per week.
• Fluent English reading and writing comprehension.
• Strong research, analytical, logical reasoning, and basic arithmetic skills.
• Creative and lateral thinking, with the ability to explain decisions clearly.
• Ability to work independently with a reliable computer and internet connection.
• Familiarity with Excel and Google Suite is valued.
• Helpful backgrounds include business analysis, research analysis, journalism, copywriting, technical writing, editing, translation, communications, literature, arts, engineering, and statistics.

About AI Training Work

AI training is the human work behind systems that learn from examples. Contributors review content and model responses, identify errors, and explain better answers so AI systems can improve; people with relevant experience or specialist knowledge may qualify for higher-paid projects.

• OpenTrain is a platform where people discover AI training and data-labeling projects, build a profile, and apply in one place.

Requirements

• Experience: Entry level

Evaluate AI-generated political content for analytical quality, rigor, and evidence-based reasoning. This part-time U.S. contract offers up to $75 per hour and requires 20+ hours per week.

Evaluate AI-generated economics content for formal accuracy, rigor, and relevance at $75 per hour. Use your economics research expertise in a flexible, 20-plus-hour weekly contract role open to candidates in the United States.

Design realistic AI benchmark tasks based on payroll, workforce planning, HR policies, and employee lifecycle work. Earn $45 to $90 per hour with less than 20 hours per week.

Use business operations expertise to review AI model outputs, apply clear rubrics, and explain your judgments. This remote contract role pays $45 to $90 per hour and typically requires less than 20 hours per week.