Residency-Trained Physician for AI Evaluation

Mercor; Nashville (TN); On-site; USD 120,000 - 180,000; Part time

Job summary

Mercor is hiring residency-trained physicians across specialties for non-clinical work developing and evaluating clinical AI systems. You will apply your clinical judgment to grading-criteria development, dialogue evaluation, and structured annotation that determines how these systems are measured.

This is a shared expert pool. After onboarding you may be matched to several concurrent clinical workstreams based on your specialty, availability, and interest, with no direct patient care or live

Qualifications

• MD or DO with a completed residency in any specialty
• Active, unrestricted medical license in your country of practice
• 3+ years post-residency clinical experience, practising or previously practising
• Comfort writing structured clinical rationale that a non-specialist reviewer can follow
• Written and spoken English fluency
• Minimum 20 hours per week, with the ability to concentrate hours when a stream is time-boxed

Responsibilities

• Grading-criteria development — take a clinical question and break the ideal answer into discrete, checkable criteria to grade models consistently
• Clinical dialogue evaluation — review multi-turn clinical conversations and judge accuracy, safety, completeness, hedging, and escalation advice
• Clinical reasoning annotation — record how you would work through a case, including differential considerations
• Output review — flag hallucinations, dangerous omissions, and clinically unsafe advice
• Guideline authoring — define edge cases and standards of care for consistency across clinicians
• Difficult-case writing — construct questions that probe current model reasoning limits

Job description

Mercor is hiring residency-trained physicians across specialties for non-clinical work developing and evaluating clinical AI systems. You will apply your clinical judgment to grading-criteria development, dialogue evaluation, and structured annotation that determines how these systems are measured.

This is a shared expert pool. After onboarding you may be matched to several concurrent clinical workstreams based on your specialty, availability, and interest, with no direct patient care or live