Clinical AI Systems Expert - MD

Mercor; New York (NY); Remote; USD 176,000 - 238,000; Part time

Job summary

Mercor seeks a General Clinician (MD/DO) for its HLS Expert Pool. This contract position offers remote work with a commitment of 20+ hours per week and compensation of $150/hour.

You will develop grading criteria, evaluate clinical dialogues for accuracy and safety, annotate clinical reasoning, and write guidelines for edge cases to support AI model evaluation.

Must have medical degree and license, 2+ years post-residency, and fluent English; board certification and US licensure preferred.

Qualifications

• MD or DO with completed residency in any specialty.
• Active, unrestricted medical license in your country of practice.
• 2+ years post-residency clinical experience.
• Comfort writing structured clinical rationale.
• Written and spoken English fluency.
• Minimum 20 hours per week.

Responsibilities

• Develop grading criteria for clinical questions to ensure consistent model response evaluation.
• Evaluate clinical dialogues for accuracy, safety, completeness, and escalation advice.
• Annotate clinical reasoning, detailing differential diagnoses considered and conclusions reached.
• Review outputs to flag hallucinated findings, omissions, and unsafe advice.
• Author guidelines to define edge cases and standards of care for consistent annotation.
• Write difficult-case scenarios to test model reasoning limits.

Skills

Structured clinical reasoning

English language fluency

Medical writing

Team collaboration

Education

MD/DO with completed residency

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: General Clinician (MD/DO) - HLS Expert Pool
Type: Contract
Compensation: $150/hour
Location: Remote
Commitment: 20+ hours/week

Role Responsibilities

• Develop grading criteria for clinical questions to ensure consistent model response evaluation.
• Evaluate clinical dialogues for accuracy, safety, completeness, and appropriate escalation advice.
• Annotate clinical reasoning, detailing differential diagnoses considered and conclusions reached.
• Review outputs to flag hallucinated findings, omissions, and unsafe advice.
• Author guidelines to define edge cases and standards of care for consistent annotation.
• Write difficult-case scenarios to test model reasoning limits.

Qualifications

Must-Have

• MD or DO with a completed residency in any specialty
• Active, unrestricted medical license in your country of practice
• 2+ years post-residency clinical experience
• Comfort writing structured clinical rationale
• Written and spoken English fluency
• Minimum 20 hours per week

Preferred

• Board certification in your specialty
• U.S. licensure and familiarity with U.S. standards of care
• Background in primary care, internal medicine, emergency medicine, or hospitalist roles
• Experience in clinical annotation, AI evaluation, or medical education
• Experience in grading-criteria design or clinical guideline development
• Published research or technical writing (please link a sample)