Critical Care Physician - AI Evaluation Specialist (Remote)

Zekai; United States; Remote; USD 124,000 - 193,000; Part time

Benefits offered by this job

Remote contract role

Flexible part-time hours

Job summary

Zekai is partnering with a leading AI lab to hire board-certified critical care physicians (MDs and DOs) to evaluate health AI models. You will read de-identified patient charts and judge AI answers to clinical questions in critical care.

In this 100% remote contract role, hourly, with flexible part-time hours, you will evaluate AI responses for accuracy, safety, and alignment with current standards of care, check against charts, decide which answer is stronger, and draft structured rationales.

Qualifications

• Board-certified in Critical Care Medicine (ABIM, ABA, ABEM or ABS) or equivalent
• Active, unrestricted US medical license
• Residency completed with fellowship if required by specialty
• Currently practicing and seeing patients in the US with ≥1 year of independent practice after training
• 3+ years post-training experience preferred
• Clear written communication and close attention to detail

Responsibilities

• Evaluate AI answers to critical care questions for clinical accuracy, safety and alignment with current standards of care
• Check each answer against the patient chart and decide which of two responses is stronger
• Write structured rationales on clinical rigor, completeness and clarity
• Flag errors that could compromise patient safety

Skills

Board certification

Active US medical license

Independent practice

Communication

Attention to detail

Education

MD or DO from an accredited medical school

Job description

Zekai is partnering with a leading AI lab to hire board-certified critical care physicians (MDs and DOs) to evaluate health AI models. You will read de-identified patient charts and judge AI answers to clinical questions in critical care.

In this 100% remote contract role, hourly, with flexible part-time hours, you will evaluate AI responses for accuracy, safety, and alignment with current standards of care, check against charts, decide which answer is stronger, and draft structured rationales.