Bilingual Mental Health AI Evaluator

OpenTrain AI, Inc.; Northern (KY); Hybrid; USD 138,000 - 276,000; Part time

Benefits offered by this job

Remote work

Job summary

OpenTrain AI, Inc. seeks a remote, part-time contractor to evaluate and improve AI-generated psychological content using your mental health expertise. You will assess case studies, conversations, and clinical scenarios, ensuring accuracy, relevance, and ethical standards.

Your feedback will guide training data and model responses in research and therapeutic contexts. Responsibilities include writing detailed feedback, identifying biases, and applying psychological frameworks to improve outputs.

Qualifications

• Ph.D. in psychology or MD with psychiatry residency.
• Advanced English language skills (written and verbal).
• Multilingual proficiency in at least one listed languages.

Responsibilities

• Evaluate and improve AI-generated psychological content.
• Check content for accuracy, ethics, cultural sensitivity, and clinical appropriateness.
• Develop and review datasets of case studies, assessments, and conversations.
• Provide detailed feedback and insights on AI responses.
• Identify bias and inaccuracies in content.

Skills

Analytical thinking

Cultural sensitivity

Multilingual communication

Interdisciplinary collaboration

Clinical psychology knowledge

Education

Ph.D. in psychology or MD with psychiatry residency

Job description

The work

You will evaluate and improve AI-generated psychological content using your mental health expertise. The material may include case studies, assessments, conversations, clinical scenarios, research vignettes, and therapeutic dialogues.

Your feedback will help improve training data and model responses in clinical, research, and therapeutic settings.

• Check content for accuracy, relevance, ethical standards, cultural sensitivity, and clinical appropriateness.
• Develop and review datasets involving psychological case studies, assessments, and conversations.
• Write detailed feedback and share verbal insights on AI-generated responses.
• Identify bias, inaccuracies, and culturally inappropriate content.
• Recommend evidence-based improvements and apply psychological concepts and frameworks.
• Support documentation and knowledge-sharing resources for continued AI development.
• Work with contributors from different professional and technical backgrounds.

What it pays and takes

This is a remote, part-time contractor role. The work is listed as 20 or more hours per week and is open to applicants in the countries included in the application.

• Pay: $100 to $200 per hour.
• Work type: Contractor and part time.
• Languages: Native proficiency in at least one of French, Malay, Russian, Mandarin, Japanese, Urdu, Swahili, Bulgarian, Tagalog, Polish, Marathi, Lithuanian, Georgian, Bengali, Vietnamese, or Indonesian.
• English: Advanced written and verbal communication skills.
• Preferred background: Ph.D. in psychology or an MD with completed psychiatry residency.
• Relevant experience: Clinical practice, psychological research, or higher education.
• Strong analytical judgment when reviewing psychological data and narrative content.
• Awareness of cultural sensitivity and ethical issues in global mental health.
• Experience with interdisciplinary or technology-focused projects is useful.

About AI training work

AI training is the human work behind systems that generate and understand text. Specialists review examples, rate model responses, and explain what accurate, safe, and useful output should look like, which is why mental health expertise matters in this role.