Medical Doctor AI Training Evaluator

OpenTrain AI, Inc.; Northern (KY); Remote; USD 96,000 - 138,000; Part time

Benefits offered by this job

Remote work

Flexible schedule

Job summary

OpenTrain AI, Inc. is seeking licensed Medical Doctors to remotely review AI-generated medical content. The role emphasizes accuracy, safety, and alignment with evidence-based standards using web-based annotation tools.

You will evaluate diagnoses, treatment plans, and case summaries, providing expert feedback and collaborating with researchers to improve model outputs. A minimum commitment of 20 hours per week for 12 weeks is required.

Qualifications

• MD or international equivalent with active US license.
• Full medical licensure and active practice in the United States.
• At least 1 year of post-residency clinical experience.

Responsibilities

• Review clinical text for accuracy, safety, harm, relevance and completeness.
• Evaluate AI-generated diagnoses, treatment plans, and case summaries.
• Provide specialist feedback on medical integrity and safety of model outputs.
• Collaborate with AI researchers and clinicians to align model performance with evidence-based standards.
• Complete structured questionnaires using web-based annotation tools.

Skills

Attention to detail

Medical license

Remote work

Web annotation tools

Clinical review

Education

MD or international equivalent

US medical licensure

Tools

Web-based annotation tools

Image zoom tools

Job description

The work

You will evaluate AI-generated medical content and give expert feedback that helps improve healthcare language model outputs. Your reviews must follow evidence-based medical standards and detailed project guidelines.

The work uses web-based annotation tools, image zoom tools, and structured questionnaires.

• Review clinical text for accuracy, safety, harmfulness, relevance, and completeness.
• Evaluate AI-generated diagnoses, treatment plans, and medical case summaries.
• Provide specialist feedback on the medical integrity and safety of language model outputs.
• Collaborate with AI researchers and clinicians to align model performance with evidence-based medical standards.
• Complete structured questionnaires using web-based annotation tools.

What the role requires

This is a remote freelance contractor assignment for licensed Medical Doctors who actively practice in the United States. The role requires strong attention to detail and comfort working with online review tools and detailed instructions.

Experience with medical content review, clinical research, annotation, or AI and machine learning evaluation is helpful. Relevant backgrounds include general medicine, critical care medicine, community medicine, and family medicine.

• Medical Doctor qualification or international equivalent, such as MD, MBBS, MBChB, or a Medical Diploma.
• Full medical licensure and active medical practice in the United States.
• At least one year of post-residency experience practicing as a Medical Doctor or General Physician.
• Strong attention to detail.
• Technical comfort with web-based annotation platforms, image zoom tools, detailed instructions, and structured questionnaires.
• Open to candidates in the United States.
• Minimum commitment of 20 hours per week for 12 weeks.
• Flexible, self-directed scheduling.

About AI training work

AI training is the human work behind artificial intelligence, including reviewing model responses and checking whether they are accurate, safe, and useful. OpenTrain is a platform where people find AI training and data-labeling projects, build a profile, and apply in one place.