Physician AI Trainer & Clinical Evaluation Specialist

Obsidian; Nashville (TN); On-site; USD 130,000 - 170,000; Full time

Job summary

Mercor is seeking residency-trained physicians for non-clinical work developing and evaluating clinical AI systems. You will apply clinical judgment to grading-criteria development, dialogue evaluation, and structured annotation to determine how these systems are measured.

This is a shared expert pool; after onboarding you may be matched to multiple streams based on specialty, availability, and interest. You may move between streams as priorities shift, with no direct patient care.

Qualifications

• MD or DO with completed residency in any specialty.
• Active, unrestricted medical license in the country of practice.
• 3+ years post-residency clinical experience.
• Comfort writing structured clinical rationale for non-specialist reviewers.
• Fluency in written and spoken English.
• Minimum 20 hours per week able to concentrate during streams.

Responsibilities

• Grading-criteria development for clinical AI evaluations.
• Clinical dialogue evaluation for accuracy, safety, and completeness.
• Clinical reasoning annotation detailing differential diagnosis considerations.
• Output review to flag hallucinations or unsafe advice.
• Guideline authoring to standardize annotation across streams.
• Difficult-case writing to probe model reasoning limits.

Skills

English fluency

Clinical experience 3+ years

Structured clinical rationale writing

Residency-trained physician

Education

MD or DO with residency

Board certification in specialty

U.S. medical licensure

Job description

Mercor is seeking residency-trained physicians for non-clinical work developing and evaluating clinical AI systems. You will apply clinical judgment to grading-criteria development, dialogue evaluation, and structured annotation to determine how these systems are measured.

This is a shared expert pool; after onboarding you may be matched to multiple streams based on specialty, availability, and interest. You may move between streams as priorities shift, with no direct patient care.