LLM Evaluation Specialist

OpenTrain AI, Inc.; Northern (KY); Hybrid; USD 45,000 - 65,000; Part time

Job summary

OpenTrain AI, Inc. is seeking an LLM Evaluation Specialist to test large language models and assess their performance. You will reason carefully, follow detailed instructions, and review model behavior in a mostly asynchronous, remote setup.

This part-time freelance contractor role pays up to $40 per hour and is open to students or graduates from any discipline. The position requires strong reasoning, attention to detail, and the ability to work independently in a flexible schedule within the

Qualifications

• Enrolled in an associate, bachelor’s, or master’s program, or completed degree.
• Strong reasoning, exceptional attention to detail, consistent accuracy.
• Comfort working independently in an asynchronous environment.
• Openness to brief training and learning new evaluation workflows.

Responsibilities

• Test large language models as part of AI training projects.
• Use general academic knowledge and reasoning to evaluate model performance.
• Follow detailed instructions while completing evaluation tasks.
• Review model behavior carefully to support better system performance.

Skills

Strong reasoning

Attention to detail

Independent work

Asynchronous work

Education

Currently enrolled in degree program or completed degree

Job description

The work

As an LLM Evaluation Specialist, you will test large language models and assess how well they perform. You will use careful reasoning, follow detailed instructions, and review model behavior accurately while working independently in a mainly asynchronous setting.

• Test large language models as part of AI training projects.
• Use general academic knowledge and reasoning to evaluate model performance.
• Follow detailed instructions while completing evaluation tasks.
• Review model behavior carefully and provide work that can support better system performance.
• Work independently in a remote, primarily asynchronous environment.

What it pays and takes

This is a part-time freelance contractor role for short-term AI training projects. The work is suitable for students and graduates from any academic discipline, and no specific professional or AI training background is required.

• Pay: Up to $40 per hour.
• Work type: Remote, part-time freelance contract work.
• Location: United States.
• Language: English.
• Hours: The structured role details list 20+ hours per week; the role description says there is no minimum weekly commitment.
• Education: Current enrollment in an associate, bachelor's, or master's program, or completion of a degree.
• Requirements: Strong reasoning, exceptional attention to detail, consistent accuracy, and comfort working independently.
• Training: Openness to brief training and learning new evaluation workflows.

About AI training work

AI training is the human work behind systems such as language models, including testing responses and rating model performance. OpenTrain hires and contracts contributors for this work, and people with strong judgment are paid to help make AI systems more useful and reliable.