Rheumatology AI Clinical Evaluator

Mercor; New York (NY); Remote; USD 240,000 - 320,000; Full time

Job summary

Mercor is hiring board-certified rheumatologists (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will read de-identified patient charts and judge AI answers to clinical questions in rheumatology.

Key responsibilities include evaluating AI answers for clinical accuracy, safety and alignment with standards, comparing responses, writing structured rationales, and flagging potential safety risks.

Qualifications

• MD or DO from an accredited medical school is required.
• Board certification in ABIM Rheumatology is required.
• Active, unrestricted US medical license is required.
• Residency completed with fellowship where applicable.
• Currently practicing in the US with at least 1 year of independent practice.
• 3+ years of post-training experience is strongly preferred.

Responsibilities

• Evaluate health AI model outputs for accuracy, safety and alignment with current standards.
• Read de-identified patient charts and judge AI answers to clinical rheumatology questions.
• Draft structured rationales on clinical rigor, completeness and clarity.
• Flag errors that could compromise patient safety.

Education

MD or DO from an accredited medical school

Board certified in ABIM Rheumatology

Active, unrestricted US medical license

Residency completed, plus fellowship where your specialty requires one

Currently practicing in the US, with at least 1 year of independent practice after training

3+ years of post-training experience strongly preferred

Job description

Mercor is hiring board-certified rheumatologists (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will read de-identified patient charts and judge AI answers to clinical questions in rheumatology.

Key responsibilities include evaluating AI answers for clinical accuracy, safety and alignment with standards, comparing responses, writing structured rationales, and flagging potential safety risks.