Psychology Expert AI Model Evaluation

OpenTrain AI, Inc.; United States; Remote; USD 97,000 - 138,000; Part time

Job summary

OpenTrain AI, Inc. is seeking contributors to help evaluate how AI models understand psychology by writing expert prompts and reviewing responses. This remote US role offers flexible project work at up to $85 per hour.

Projects run year-round with assignments in psychology concepts, research areas, and subdomains. You will write prompts grounded in psychology, review model outputs for accuracy, and research topics with AI support.

Qualifications

• Master's degree in psychology from a US institution.
• Strong psychology knowledge and disciplinary research experience.
• Fluent English in professional context.
• Ability to work asynchronously and independently.

Responsibilities

• Write prompts grounded in psychology concepts, research areas, and subdomains.
• Review large language model responses for scientific accuracy and quality of language understanding.
• Research psychology topics with AI support and use findings to inform responses.
• Explain key psychology concepts clearly and identify gaps in model outputs.
• Contribute to research tasks that test and improve specialized AI model capabilities.

Skills

Explain psychology concepts precisely

Assess AI responses for accuracy

Strong psychology knowledge

Disciplinary research experience

Education

Master's degree in psychology (US institution)

Doctoral study or completed doctorate in psychology

Job description

Help evaluate how well AI models understand psychology by writing expert prompts and reviewing responses. This remote US role offers flexible project work at up to $85 per hour.

Remote Hourly $85/hr

$85/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Posted

Open to applicants in

United States

The work

You will support AI research and model evaluation focused on psychology. Your work will test whether large language models understand and explain psychology concepts accurately and clearly.

Projects run throughout the year, with assignments depending on available work in the relevant subject area.

• Write prompts grounded in psychology concepts, research areas, and subdomains.
• Review large language model responses for scientific accuracy and quality of language understanding.
• Research psychology topics with AI support and use the findings to inform your responses.
• Explain key psychology concepts clearly and identify gaps in model outputs.
• Contribute to research tasks that test and improve specialized AI model capabilities.

What it pays and takes

This is remote, asynchronous project work for candidates in the United States.

• Pay: Up to $85 per hour for qualifying project work.
• Schedule: Flexible hours with a time requirement of 20 or more hours per week.
• Location: Open to candidates in the United States.
• Language: Professional fluency in English.
• Education: A master's degree from a US institution is required.
• Expertise: Strong psychology knowledge and disciplinary research experience.
• Skills: Explain psychology concepts precisely and assess whether AI responses show accurate subject understanding.
• Work style: Comfortable working independently in a primarily asynchronous setting.
• Helpful background: Doctoral study or a completed doctorate in psychology, especially in emerging research areas.

About AI training work

AI training is the human work behind systems that learn from examples, including writing prompts and reviewing model responses. OpenTrain is where people find these projects, build an AI training profile, and apply to opportunities across the industry.