Multilingual Primary Care Physician AI Evaluator

OpenTrain AI; Northern (KY); Hybrid; USD 234,000 - 262,000; Part time

Benefits offered by this job

Remote work

Flexible scheduling

Part-time contractor

Competitive pay $170-$190/hr

Job summary

OpenTrain AI is recruiting a multilingual Primary Care Physician to support clinical documentation and AI evaluation. You will review outpatient notes and encounter data, assess AI-generated documentation, and provide structured feedback focused on accuracy, completeness, clinical soundness, and patient-care relevance.

This is remote, part-time contractor work requiring at least 10 hours of weekly availability. Scheduling is flexible and designed to fit around an active clinical practice.

Qualifications

• MD credential required.
• Minimum two years of post-residency experience.
• Current practice in primary care, family medicine, or general internal medicine.
• Direct outpatient clinical note-writing experience.
• Ability to evaluate AI-generated documentation for omissions, hallucinations, and inaccuracies.
• United States-based with advanced English proficiency (C1).
• Proficiency in at least one additional language.

Responsibilities

• Review outpatient notes, encounter summaries, and EHR documentation.
• Assess documentation for accuracy, completeness, and clinical soundness.
• Compare AI-generated notes with primary care documentation standards.
• Annotate outpatient encounter data using detailed guidelines.
• Identify omissions, hallucinations, and documentation gaps.
• Write structured feedback to guide improvements to medical AI systems.
• Contribute expertise on documentation standards, annotation guidance, and edge-case definitions.
• Raise clarifying questions when clinical instructions are ambiguous.

Skills

MD credential

Post-residency experience

Outpatient practice

Clinical note-writing

English proficiency (C1)

Second language proficiency

Education

MD degree

Tools

Epic

Job description

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this role and the #1 platform for finding and building careers in AI training and data labeling. OpenTrain helps contributors discover specialized projects, build a credible profile, and apply in minutes.

• Work directly on projects that help improve AI systems.
• Build a durable portfolio of AI training and evaluation experience.
• Create an OpenTrain account for free.

About AI Training Work

AI training is the human side of building artificial intelligence. Experts review examples, evaluate model outputs, and provide structured feedback so AI systems become more accurate, useful, and reliable. In this role, your clinical judgment will help shape tools used for medical documentation and decision support.

• Apply real-world professional expertise to cutting-edge AI development.
• Work remotely with flexible scheduling.
• Contribute to the improvement of medical documentation technology.

The Role

OpenTrain is recruiting a multilingual Primary Care Physician to support clinical documentation and decision-support AI evaluation. You will review outpatient notes and encounter data, assess AI-generated documentation, and provide structured feedback focused on accuracy, completeness, clinical soundness, and patient-care relevance.

This is remote, part-time contractor work requiring at least 10 hours of weekly availability. Scheduling is flexible and designed to fit around an active clinical practice. The pay rate is $170-$190 per hour.

• Work arrangement: Remote, part-time contractor
• Minimum availability: 10 hours per week
• Pay: $170-$190 per hour
• Location: United States

What You’ll Do

You will use current outpatient practice experience to compare AI-generated notes and summaries with the documentation standards used by practicing primary care physicians. Your reviews will help identify where medical AI systems need more accurate, complete, and clinically sound outputs.

• Review outpatient clinical notes, encounter summaries, and EHR documentation.
• Assess documentation for accuracy, completeness, and clinical soundness.
• Compare AI-generated notes and summaries with primary care documentation standards.
• Annotate outpatient encounter data using detailed guidelines.
• Identify omissions, hallucinations, clinical inaccuracies, and documentation gaps.
• Write structured feedback to guide improvements to medical AI systems.
• Contribute expert input on documentation standards, annotation guidance, and edge-case definitions.
• Raise clarifying questions when clinical instructions are ambiguous.

Required Qualifications

This role requires an MD and at least two years of post-residency experience in current primary care, family medicine, or general internal medicine practice. Direct experience writing accurate clinical notes in an outpatient setting is required.

Candidates must be based in the United States and communicate at an advanced C1 level or higher in English, including speaking, listening, and writing. You must also have advanced proficiency in at least one additional specified language.

• MD credential
• At least two years of post-residency experience
• Current practice in primary care, family medicine, or general internal medicine
• Direct outpatient clinical note-writing experience
• Ability to evaluate AI-generated documentation for omissions, hallucinations, and clinical inaccuracies
• United States-based
• C1-level or higher spoken, listening, and written English proficiency
• C1-level or higher proficiency in at least one additional specified language

Helpful Background

The following experience is useful for this work but is not listed as required. It can help you contribute efficiently to documentation review, annotation guidance, and medical AI evaluation.

• Clinical documentation quality review
• Note auditing or clinical documentation improvement
• Familiarity with Epic
• Prior AI or machine-learning annotation and model evaluation
• Strong performance in comparable review work
• Experience documenting patient care in a language other than English

How to Build Your AI Training Career

OpenTrain gives professionals one place to find and manage AI training opportunities while building a profile that reflects their experience. By applying your clinical expertise to model evaluation, you can contribute to a fast-growing field that depends on knowledgeable human review.

• Use your professional expertise in a flexible remote setting.
• Build experience teaching and evaluating modern AI systems.