Primary Care Physician - AI Evaluator

Mercor; San Francisco (CA); On-site; USD 83,000 - 138,000; Part time

Job summary

Mercor is hiring practicing Primary Care Physicians (MD) to review, annotate, and evaluate clinical documentation for an AI partner building advanced clinical documentation and decision-support tools.

This role is for physicians currently practicing primary care, family medicine, or general internal medicine in the United States, with at least 2 years post-residency and a minimum of 10 hours per week through mid-November. Remote collaboration may be possible.

Qualifications

• MD with 2+ years of post-residency practice.
• Currently practicing primary care / family medicine / internal medicine in the US.
• Available for at least 10 hours per week through mid-November.

Responsibilities

• Review clinical notes, encounter summaries, and EHR documentation for accuracy, completeness, and clinical soundness
• Evaluate AI-generated notes and summaries against what a practicing PCP would actually document
• Annotate encounter data against detailed guidelines
• Flag omissions, hallucinations, clinical inaccuracies, and documentation gaps in AI-generated output
• Provide structured, written feedback that engineering and product teams can act on
• Contribute expert input on annotation guidelines, documentation standards, and edge-case definitions
• Raise clarifying questions where guidance is ambiguous and help refine the guidelines

Skills

Clinical annotation

Medical documentation review

Education

MD

2+ years post-residency

Job description

About the Role

Mercor is hiring practicing Primary Care Physicians (MD) on behalf of a healthcare AI partner building advanced clinical documentation and decision-support tools. In this role you will apply your day-to-day primary care expertise to review, annotate, and evaluate clinical documentation, directly shaping the accuracy, safety, and clinical usefulness of medical AI systems.

This role is designed for physicians who are currently practicing primary care, family medicine, or general internal medicine.

Key Responsibilities

Clinical Documentation Review

• Review clinical notes, encounter summaries, and EHR documentation for accuracy, completeness, and clinical soundness




• Evaluate AI-generated notes and summaries against what a practicing PCP would actually document

Annotation & Structured Feedback

• Annotate encounter data against detailed guidelines




• Flag omissions, hallucinations, clinical inaccuracies, and documentation gaps in AI-generated output




• Provide structured, written feedback that engineering and product teams can act on

Knowledge Contribution

• Contribute expert input on annotation guidelines, documentation standards, and edge-case definitions




• Raise clarifying questions where guidance is ambiguous and help refine the guidelines

Required Qualifications

• MD, with 2+ years post-residency




• Currently practicing primary care / family medicine / general internal medicine




• US-based




• Available for a minimum of 10 hours/week through mid-November

Preferred Qualifications

• Prior AI/ML annotation or model evaluation work experience, with strong performance reviews