Multilingual Outpatient Physician AI Evaluator

OpenTrain AI; Northern (KY); Hybrid; USD 234,000 - 262,000; Part time

Benefits offered by this job

Remote work from US

Part-time contract

Hourly pay $170–$190

Job summary

OpenTrain AI is recruiting practicing outpatient physicians to review and annotate clinical documentation for medical AI evaluation. You will assess outpatient notes, encounter summaries, and EHR documentation, then evaluate AI-generated notes against standards used by practicing physicians.

This is remote, part-time contract work for candidates based in the United States. The hourly rate ranges from $170 to $190, with a minimum of 10 hours per week.

Qualifications

• MD or DO medical degree.
• Current outpatient or ambulatory clinical practice required.
• Direct experience writing outpatient notes.
• Residence in the United States.
• English communication plus advanced C1 or higher in Czech, Catalan, Danish, Dutch, Vietnamese, or Finnish.

Responsibilities

• Review outpatient clinical notes, encounter summaries, and EHR documentation.
• Assess documentation for accuracy, completeness, and clinical soundness.
• Evaluate AI-generated notes against real-world physician documentation.
• Annotate outpatient encounter data using detailed guidelines.
• Identify omissions, hallucinations, clinical inaccuracies, and documentation gaps.
• Provide written feedback to support improvements to medical AI systems.

Skills

Outpatient experience

Clinical documentation

Multilingual (C1+)

Education

MD or DO degree

Tools

Epic

Job description

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We connect skilled professionals with specialized projects where human expertise helps shape the next generation of artificial intelligence.

Create a free OpenTrain account to build your professional profile, discover relevant opportunities, and apply in minutes. Your work can become part of a long-term portfolio in a rapidly growing field.

• Remote AI training and data-labeling opportunities
• Flexible projects for part-time and specialist contributors
• A profile designed to help you build experience in AI training

About Clinical AI Evaluation

AI training is the human side of building artificial intelligence. Medical AI systems learn from carefully reviewed examples, including clinical notes, encounter summaries, and other documentation prepared and evaluated by qualified professionals.

In this role, your clinical judgment will help assess whether AI-generated documentation is accurate, complete, clinically sound, and consistent with real-world physician standards.

• Help improve how medical AI systems understand clinical documentation
• Apply professional expertise to model evaluation and structured annotation
• Contribute to cutting-edge AI development through expert human feedback

The Role

OpenTrain is recruiting practicing outpatient physicians to review and annotate clinical documentation for medical AI evaluation. You will assess outpatient notes, encounter summaries, and EHR documentation, then evaluate AI-generated notes against the standards used by practicing physicians.

You will also provide structured feedback on annotation standards and difficult clinical cases. This is remote, part-time contract work for candidates based in the United States.

• Role focus: Clinical documentation AI evaluation
• Work arrangement: Remote, part-time contract
• Location: United States
• Availability: Minimum of 10 hours per week and less than 20 hours per week
• Pay: $170 to $190 per hour

What You’ll Do

You will use your outpatient clinical experience to evaluate documentation quality and identify problems that could affect the reliability of medical AI systems. Your reviews will support improvements to model outputs, annotation guidelines, and clinical evaluation processes.

• Review outpatient clinical notes, encounter summaries, and EHR documentation
• Assess documentation for accuracy, completeness, and clinical soundness
• Evaluate AI-generated notes and summaries against real-world physician documentation
• Annotate outpatient encounter data using detailed guidelines
• Identify omissions, hallucinations, clinical inaccuracies, and documentation gaps
• Provide written feedback to support improvements to medical AI systems
• Contribute expert input on documentation standards and clarify difficult clinical cases

Requirements

This opportunity requires medical training, current outpatient practice, and advanced multilingual communication skills. You must be able to evaluate clinical documentation in English and communicate in one additional listed language at an advanced C1 level or higher.

• MD or DO degree
• Current outpatient or ambulatory clinical practice
• Direct experience writing outpatient clinical notes
• Experience evaluating documentation quality
• Residence in the United States
• English communication skills plus advanced C1 or higher speaking, listening, and writing proficiency in Czech, Catalan, Danish, Dutch, Vietnamese, or Finnish
• Ability to identify omissions, hallucinations, clinical inaccuracies, and documentation gaps in AI-generated notes

Preferred Experience

The role is listed as entry level within AI training, so previous AI project experience is not required. Clinical expertise and documentation experience are the foundation for the work.

• Two or more years of clinical practice after residency
• Familiarity with Epic
• Clinical documentation quality review
• Clinical documentation improvement or CDI
• Note auditing
• AI or machine learning annotation
• Model evaluation
• Documenting patient care in another language

Flexible Remote Work

Schedule your work flexibly around an active clinical practice, with a minimum availability of 10 hours per week and less than 20 hours per week. The hourly rate is $170 to $190, and the engagement is structured as part-time contract work.

• Work remotely from the United States
• Choose a flexible schedule around your clinical practice
• Commit at least 10 hours per week
• Earn $170 to $190 per hour