Clinical AI Evaluation Expert

Mercor; United States; Remote; USD 165,000 - 248,000; Part time

Job summary

Mercor is partnering with a leading AI research lab to train frontier models on clinical and biomedical reasoning. We’re hiring Healthcare Experts to evaluate model outputs and ensure medical accuracy, evidence-based reasoning, and alignment with real-world patient care.

You will compare two AI responses, explain why one is better, and provide feedback to improve model behavior. Requirements include an MD/DO/PharmD/PhD or equivalent, plus 2+ years in clinical practice or medical research.

Qualifications

• Must have a clinical degree (MD/DO/PharmD/PhD) or equivalent.
• 2+ years of professional experience in clinical practice, medical research, or a biomedical specialty.
• Comfortable applying current clinical guidelines and evidence-based medicine.
• Demonstrate excellent written communication with high attention to detail.

Responsibilities

• Evaluate and compare model outputs on challenging medical problems.
• Explain why one output outperforms the other with citations to clinical accuracy and safety.
• Provide written feedback to help improve model behavior.
• Participate in onboarding and specialty calibration sessions.

Skills

Clinical experience

Evidence-based medicine

Written communication

Attention to detail

Education

MD/DO/PharmD/PhD or advanced degree

Job description

Mercor is partnering with a leading AI research lab to train frontier models on clinical and biomedical reasoning. We’re hiring Healthcare Experts to evaluate model outputs and ensure medical accuracy, evidence-based reasoning, and alignment with real-world patient care.

You will compare two AI responses, explain why one is better, and provide feedback to improve model behavior. Requirements include an MD/DO/PharmD/PhD or equivalent, plus 2+ years in clinical practice or medical research.