LLM Evaluation Specialist

OpenTrain AI, Inc.

United States

Hybrid

USD 45,000 - 65,000

Part time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

OpenTrain AI, Inc. is seeking an LLM Evaluation Specialist to test large language models and assess their performance. You will reason carefully, follow detailed instructions, and review model behavior in a mostly asynchronous, remote setup.

This part-time freelance contractor role pays up to $40 per hour and is open to students or graduates from any discipline. The position requires strong reasoning, attention to detail, and the ability to work independently in a flexible schedule within the

Qualifications

  • Enrolled in an associate, bachelor’s, or master’s program, or completed degree.
  • Strong reasoning, exceptional attention to detail, consistent accuracy.
  • Comfort working independently in an asynchronous environment.
  • Openness to brief training and learning new evaluation workflows.

Responsibilities

  • Test large language models as part of AI training projects.
  • Use general academic knowledge and reasoning to evaluate model performance.
  • Follow detailed instructions while completing evaluation tasks.
  • Review model behavior carefully to support better system performance.

Skills

Strong reasoning
Attention to detail
Independent work
Asynchronous work

Education

Currently enrolled in degree program or completed degree

Job description

The work

As an LLM Evaluation Specialist, you will test large language models and assess how well they perform. You will use careful reasoning, follow detailed instructions, and review model behavior accurately while working independently in a mainly asynchronous setting.

  • Test large language models as part of AI training projects.
  • Use general academic knowledge and reasoning to evaluate model performance.
  • Follow detailed instructions while completing evaluation tasks.
  • Review model behavior carefully and provide work that can support better system performance.
  • Work independently in a remote, primarily asynchronous environment.
What it pays and takes

This is a part-time freelance contractor role for short-term AI training projects. The work is suitable for students and graduates from any academic discipline, and no specific professional or AI training background is required.

  • Pay: Up to $40 per hour.
  • Work type: Remote, part-time freelance contract work.
  • Location: United States.
  • Language: English.
  • Hours: The structured role details list 20+ hours per week; the role description says there is no minimum weekly commitment.
  • Education: Current enrollment in an associate, bachelor's, or master's program, or completion of a degree.
  • Requirements: Strong reasoning, exceptional attention to detail, consistent accuracy, and comfort working independently.
  • Training: Openness to brief training and learning new evaluation workflows.
About AI training work

AI training is the human work behind systems such as language models, including testing responses and rating model performance. OpenTrain hires and contracts contributors for this work, and people with strong judgment are paid to help make AI systems more useful and reliable.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

LLM Content Evaluation Analyst
LLM Content Evaluation Analyst

OpenTrain AI, Inc. • United States

Remote
USD 62,000 - 124,000
Remote work
LLM Evaluation Domain Expert · Turing Turing · Varies · remote · 4w ago Varies 4w ago
LLM Evaluation Domain Expert · Turing Turing · Varies · remote · 4w ago Varies 4w ago

Benture • San Francisco (CA)

Hybrid
USD 90,000 - 150,000
Learning & Pedagogy LLM Evaluation Project
Learning & Pedagogy LLM Evaluation Project

Revelo • United States

Remote
USD 34,000 - 83,000
AI QA Trainer - LLM Evaluation - Freelance Project
AI QA Trainer - LLM Evaluation - Freelance Project

Meridial • United States

Remote
USD 8,265 - 89,544
Secure computer and high-speed internet required
Remote AI Trainer & Evaluator for LLMs (RLHF)
Remote AI Trainer & Evaluator for LLMs (RLHF)

prolificacademicltd • United States

Remote
USD 91,000 - 129,000
Remote work
Flexible hours
Up to $80/hour
LLM Evaluation Specialist — Flexible, Freelance
LLM Evaluation Specialist — Flexible, Freelance

Revelo • United States

Remote
USD 55,000 - 110,000
Senior Python Engineer, LLM Code Evaluation (US)
Senior Python Engineer, LLM Code Evaluation (US)

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 124,000
Remote work
AI QA Trainer - LLM Evaluation
AI QA Trainer - LLM Evaluation

Meridial • United States

Remote
USD 8,300 - 90,000
LLM Model Response Evaluation
LLM Model Response Evaluation

Upwork • Maryland City (MD)

Remote
USD 28,000 - 55,000
Research & Evaluation Project
Research & Evaluation Project

Revelo • United States

Remote
USD 55,000 - 110,000