Remote LLM Evaluation Specialist - Part-Time

OpenTrain AI, Inc.; Northern (KY); Hybrid; USD 45,000 - 65,000; Part time

Job summary

OpenTrain AI, Inc. is seeking an LLM Evaluation Specialist to test large language models and assess their performance. You will reason carefully, follow detailed instructions, and review model behavior in a mostly asynchronous, remote setup.

This part-time freelance contractor role pays up to $40 per hour and is open to students or graduates from any discipline. The position requires strong reasoning, attention to detail, and the ability to work independently in a flexible schedule within the

Qualifications

• Enrolled in an associate, bachelor’s, or master’s program, or completed degree.
• Strong reasoning, exceptional attention to detail, consistent accuracy.
• Comfort working independently in an asynchronous environment.
• Openness to brief training and learning new evaluation workflows.

Responsibilities

• Test large language models as part of AI training projects.
• Use general academic knowledge and reasoning to evaluate model performance.
• Follow detailed instructions while completing evaluation tasks.
• Review model behavior carefully to support better system performance.

Skills

Strong reasoning

Attention to detail

Independent work

Asynchronous work

Education

Currently enrolled in degree program or completed degree

Job description

OpenTrain AI, Inc. is seeking an LLM Evaluation Specialist to test large language models and assess their performance. You will reason carefully, follow detailed instructions, and review model behavior in a mostly asynchronous, remote setup.

This part-time freelance contractor role pays up to $40 per hour and is open to students or graduates from any discipline. The position requires strong reasoning, attention to detail, and the ability to work independently in a flexible schedule within the