Psychology Expert (LLM Evaluation)

OpenTrain AI, Inc.; United States; Remote; USD 45,000 - 76,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a part-time, remote contractor with advanced psychology knowledge to create domain-specific prompts and evaluate AI model responses for accuracy and clarity.

You will research psychology topics with AI assistance, develop prompts to test knowledge, and assess explanations against established concepts. The role is remote, less than 20 hours per week, with pay up to $55 per hour.

Qualifications

• Master's degree in psychology from a US institution.
• Experience creating domain-specific prompts for psychology.
• Experience evaluating AI responses for quality and accuracy.
• Experience conducting psychology research.
• Ability to work independently and meet deadlines.

Responsibilities

• Create prompts that test knowledge of psychology concepts.
• Evaluate AI-generated responses for quality and accuracy.
• Research psychology topics with AI tools.
• Complete tasks that test scientific and language understanding.
• Use psychology and research judgment when comparing model responses with accurate domain knowledge.

Skills

Advanced psychology knowledge

Prompt creation for psychology

Evaluating AI responses

Psychology research

Education

Master's degree in psychology

Tools

AI tools

Job description

Create psychology prompts, research topics with AI assistance, and rate large language model responses for accuracy and quality. This remote, asynchronous role offers up to $55 per hour and less than 20 hours per week.

Remote Hourly · $55/hr

$55/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Posted

Open to applicants in

United States

The work

You will help evaluate large language models, or AI systems that generate text. Your work will focus on psychology topics and on whether model responses explain specialized concepts accurately and clearly.

The work is remote and asynchronous, with flexible participation and assignments based on project availability.

• Create prompts that test knowledge of psychology concepts and specialized areas.
• Evaluate AI-generated responses for quality and accuracy.
• Research psychology topics with assistance from AI tools.
• Complete tasks that test scientific and language understanding.
• Use psychology and research judgment when comparing model responses with accurate domain knowledge.

What it pays and takes

This is a part-time contractor role for someone with advanced psychology knowledge and specialized disciplinary or research expertise. Experience creating domain-specific prompts, evaluating AI responses, or conducting psychology research may help you contribute effectively.

• Pay: Up to $55 per hour.
• Time: Less than 20 hours per week.
• Location: Open to candidates in the United States.
• Education: A master's degree from a US institution is required.
• Requirements: Advanced psychology knowledge, clear explanation skills, independent work habits, and strong judgment when assessing model responses.

About AI training work

AI training is the human work behind artificial intelligence, including writing prompts and reviewing model responses. OpenTrain is a free platform where people find AI training and data-labeling projects, build a profile, and apply to opportunities in one place.