Rheumatology AI Clinical Evaluator

Mercor; New York (NY); On-site; USD 280,000 - 420,000; Full time

Job summary

Mercor is hiring board-certified rheumatologists (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will read de-identified patient charts and judge AI answers to clinical questions in rheumatology.

Key responsibilities include evaluating AI answers for clinical accuracy and safety, checking charts, deciding which response is stronger, writing structured rationales, and flagging errors that could compromise patient safety.

Qualifications

• MD or DO from an accredited medical school.
• ABIM Rheumatology board certification.
• Active, unrestricted US medical license.
• Residency completed, plus fellowship where required.
• Currently practicing in the US with at least 1 year of independent practice after training.
• 3+ years post-training experience preferred.

Responsibilities

• Evaluate AI answers to rheumatology questions for clinical accuracy, safety and alignment with current standards of care.
• Check each answer against the patient chart and decide which of two responses is stronger.
• Write structured rationales on clinical rigor, completeness and clarity.
• Flag errors that could compromise patient safety.

Education

MD or DO from an accredited medical school

Board certified in ABIM Rheumatology

Active US medical license

Residency completed; fellowship where required

Job description

Mercor is hiring board-certified rheumatologists (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will read de-identified patient charts and judge AI answers to clinical questions in rheumatology.

Key responsibilities include evaluating AI answers for clinical accuracy and safety, checking charts, deciding which response is stronger, writing structured rationales, and flagging errors that could compromise patient safety.