MD Physician — Clinical AI Evaluation & Reasoning

Mercor; New York (NY); On-site; USD 100,000 - 170,000; Full time

Job summary

Mercor seeks residency-trained physicians to join a non-clinical cohort evaluating and developing clinical AI systems. You will apply clinical judgment to grading criteria, dialogue evaluation, and structured annotation to measure model performance.

The role is shared across streams, with the possibility of moving between projects as priorities shift. A strong clinical background and clear, structured reasoning are essential.

Qualifications

• MD or DO with completed residency and active medical license.
• 3+ years post-residency clinical experience.
• Fluent written and spoken English.

Responsibilities

• Grading-criteria development for models.
• Clinical dialogue evaluation for accuracy and safety.
• Clinical reasoning annotation describing differential reasoning.
• Output review to flag hallucinations or unsafe advice.
• Guideline authoring to standardize care.
• Difficult-case writing to probe model limits.

Education

MD or DO with completed residency

Job description

Mercor seeks residency-trained physicians to join a non-clinical cohort evaluating and developing clinical AI systems. You will apply clinical judgment to grading criteria, dialogue evaluation, and structured annotation to measure model performance.

The role is shared across streams, with the possibility of moving between projects as priorities shift. A strong clinical background and clear, structured reasoning are essential.