Clinical AI Evaluation

MyRemoteTeam Inc; Washington; Remote; USD 138,000 - 207,000; Part time

Benefits offered by this job

Fully remote

Part-time (10–20 hrs/wk)

Project-based contract

4-week engagement

Job summary

MyRemoteTeam Inc. seeks actively practicing US physicians to support a Clinical AI Evaluation project. You will review AI-generated clinical answers for accuracy, clinical reasoning, and alignment with safe medical practice.

Ideal candidates are MD/DO with an active license, board certification or completed residency, and recent direct patient-care experience. This is a fully remote, project-based role offering 10–20 hours per week for ~4 weeks.

Qualifications

• MD or DO with active US license.
• Board certification or completed residency.
• Current practice with recent patient-care experience; attending physicians preferred.
• 3–6 years post-residency clinical experience preferred.
• Excellent written English; ability to clearly communicate clinical judgments.
• Experience across multiple medical conditions and systems.

Responsibilities

• Review AI-generated clinical answers for medical accuracy and completeness.
• Evaluate clinical reasoning, differential diagnoses, and treatment recommendations.
• Identify factual errors, omissions, and patient-safety concerns.
• Assess alignment with evidence-based medical practice.
• Provide structured feedback and explain inaccuracies when needed.
• Maintain consistent evaluation quality throughout the project.

Skills

Strong written English

Broad clinical experience across many/

Education

MD or DO

Active US medical license

Board certification or residency completed

Job description

We are seeking actively practicing US physicians to support a Clinical AI Evaluation project. Selected physicians will review AI-generated clinical answers and assess their accuracy, clinical reasoning, completeness, relevance, and alignment with safe medical practice.

This is an opportunity for practicing physicians interested in contributing their clinical expertise to the evaluation and improvement of AI systems.

Key Responsibilities

• Review AI-generated clinical answers for medical accuracy and completeness.
• Evaluate clinical reasoning, differential diagnoses, and treatment recommendations.
• Identify factual errors, unsupported conclusions, omissions, and potential patient-safety concerns.
• Assess whether responses align with evidence-based medical practice.
• Provide structured feedback and explain clinical inaccuracies when necessary.
• Maintain consistent evaluation quality throughout the project.

Required Qualifications

• MD or DO degree.
• Active, unrestricted US medical license.
• Completed residency training or board certification.
• Currently practicing with recent, direct patient-care experience; attending physicians are preferred.
• Approximately 3–6 years of post-residency clinical experience preferred.
• Strong written English and the ability to communicate clinical judgments clearly.
• Broad experience with diagnosis and treatment across multiple medical conditions and systems.

Preferred specialties:

• Internal Medicine
• Family Medicine

Experience with medical AI evaluation, clinical content review, medical question writing, annotation, or quality assurance is an advantage but is not required.

Work Arrangement

• Fully remote, part-time engagement.
• Approximately 10–20 hours per week.
• Expected duration of approximately 4 weeks.
• Project-based contract with tasks assigned according to project requirements.

Important State Eligibility Restrictions

Due to client restrictions, physicians currently residing in the following states are not eligible:

Alaska, Arkansas, California, Connecticut, Delaware, Georgia, Hawaii, Illinois, Indiana, Kansas, Louisiana, Maine, Maryland, Massachusetts, Nebraska, Nevada, New Hampshire, New Jersey, New Mexico, Ohio, Oregon, Tennessee, Utah, Vermont, Washington, and West Virginia.

Applicants must confirm their current state of residence and hold an active, unrestricted medical license in an eligible US state.

We look forward to connecting with physicians who want to contribute their clinical expertise to the advancement of AI evaluation.