Medicine LLM Evaluation Expert

OpenTrain AI, Inc.; United States; Remote; USD 142,000 - 202,000; Part time

Job summary

OpenTrain AI, Inc. is seeking medical experts to remotely evaluate and improve medicine-focused language model prompts and AI explanations. You will write specialty prompts and assess AI outputs for accuracy and clarity.

The role is remote and hourly, ~20+ hours/week, requiring MD/DO/PhD from a US institution, strong medical knowledge and independent work. Fluency in English and the ability to explain complex topics clearly are essential.

Qualifications

• MD/DO/PhD with medical expertise.
• Experience in medical education, research, or technical content evaluation.
• Ability to explain complex medical topics clearly to non-specialists.

Responsibilities

• Create prompts about medicine and specialized medical topics.
• Review AI responses for scientific accuracy and clarity.
• Research specialized medical topics with AI assistance.
• Identify strengths and limitations in AI-generated medical explanations.
• Compare AI outputs with medical standards and provide evidence-based judgments.

Skills

Medical expertise

Research ability

Medical education communication

Independent work

Education

MD/DO/PhD from US institution

Job description

Review and improve medicine-focused large language model responses, create expert prompts, and research specialized topics remotely. The partner title and supplied description name different subjects. Review the duties and qualifications before applying.

Remote Hourly · $125/hr

$125/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Posted

Open to applicants in

United States

The work

The partner title and supplied description name different subjects. Review the duties and qualifications before applying.

You will help evaluate how well large language models understand and explain medicine. The work combines medical research judgment, prompt writing, and careful review of AI-generated responses.

You will work mainly asynchronously and independently on expert tasks that test scientific and language capabilities in advanced AI systems.

• Create prompts about medicine and specialized medical topics.
• Review AI responses for scientific accuracy, clarity, and meaningful understanding.
• Research specialized medical topics with assistance from AI.
• Identify strengths and limitations in AI-generated medical explanations.
• Compare technical responses with the standards of the medical field and provide evidence-based judgments.

What it pays and takes

This project is suited to medical experts who can explain important concepts clearly and assess technical content. Experience with emerging research areas, scientific writing, medical education, or technical content evaluation can help you contribute.

• Pay: Up to $125 per hour.
• Work arrangement: Remote, asynchronous project work with flexible hours.
• Time requirement: 20+ hours per week.
• Location: Open to candidates in the United States.
• Language: Professional fluency in English.
• Education: M.D., D.O., or PhD from a US institution.
• Requirements: Strong medical expertise, research ability, clear medical communication, and comfort working independently.

About AI training work

AI training is the human work behind systems that learn from examples, including writing prompts and reviewing model responses. People with specialist knowledge, such as medicine, help assess whether AI explanations are accurate, clear, and useful.