Critical Care Physician - Evaluator

Mercor; New York (NY); Remote; USD 227,000 - 324,000; Part time

Job summary

Mercor is seeking a Critical Care Physician for a remote, contract role with immediate start. You will evaluate AI-generated clinical answers, verify accuracy against patient charts, and write structured rationales to improve model safety and quality. Independent, asynchronous work with flexible part-time hours is expected.

Applicants must be US-licensed, board-certified in Critical Care Medicine, and have 3+ years post-training experience. Remote work allowed.

Qualifications

• MD or DO from an accredited medical school.
• Board certification in Critical Care Medicine (ABIM, ABA, ABEM or ABS) through an ABMS member board or the AOA.
• Active, unrestricted US medical license.
• Residency completed, plus fellowship where your specialty requires one.
• Currently practicing and seeing patients in the US, with at least 1 year of independent practice after training.
• 3+ years of post-training experience strongly preferred.
• Clear written communication and close attention to detail.

Responsibilities

• Evaluate AI answers to critical care questions for clinical accuracy, safety, and alignment with current standards of care.
• Check each answer against the patient chart and decide which of two responses is stronger.
• Write structured rationales on clinical rigor, completeness, and clarity.
• Flag errors that could compromise patient safety.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Clear written communication

Attention to detail

Independent work

Education

MD or DO

Board certified in Critical Care Medicine (ABIM, ABA, ABEM or ABS)

Active, unrestricted US medical license

Residency completed, plus fellowship where required

Currently practicing in the US with 1 year of independent practice

3+ years of post-training experience

Clear written communication and close attention to detail

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Critical Care Physician
Type: Contract
Compensation: $200/hour
Location: Remote
Commitment: Flexible part-time hours

Role Responsibilities

• Evaluate AI answers to critical care questions for clinical accuracy, safety, and alignment with current standards of care.
• Check each answer against the patient chart and decide which of two responses is stronger.
• Write structured rationales on clinical rigor, completeness, and clarity.
• Flag errors that could compromise patient safety.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Qualifications

Must-Have

• MD or DO from an accredited medical school.
• Board certified in Critical Care Medicine (ABIM, ABA, ABEM or ABS) through an ABMS member board or the AOA.
• Active, unrestricted US medical license.
• Residency complete, plus fellowship where your specialty requires one.
• Currently practicing and seeing patients in the US, with at least 1 year of independent practice after training.
• 3+ years of post-training experience strongly preferred.
• Clear written communication and close attention to detail.

Start Date

• Immediate