Clinical AI Lead - MD, Medical AI Evaluation

Lumos AI Research

San Francisco (CA)

On-site

USD 180,000 - 300,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Lumos AI Research in San Francisco seeks a medical doctor to lead clinical evaluation efforts for medical AI. This full-time role centers on creating gold-standard clinical cases, adjudicating expert work, and collaborating with engineers to build RL environments and verifiers that test model safety in real clinical scenarios.

You will drive the clinical quality criteria, identify model weaknesses, and serve as the credible clinical voice for customers and the physician network.

Qualifications

  • MD or DO with US residency in Internal Medicine, Family Medicine, or Cardiology.
  • US board certification in Internal Medicine, Cardiovascular Disease, or Family Medicine.
  • 3+ years of post-residency clinical experience.
  • Strong command of evidence-based medicine and clinical reasoning under uncertainty.
  • Comfort working with structured clinical data and EHR concepts, and collaboration with engineers/researchers.

Responsibilities

  • Build gold-standard, expert-annotated clinical cases and reference solutions across internal medicine, cardiology, and primary care.
  • Review and adjudicate the work of a network of physician experts; own the clinical quality bar and rubrics.
  • Design and ship RL environments and verifiers for clinical agents with the research/engineering team; translate correctness and safety into signals.
  • Stress-test and red-team models on clinical tasks; identify red flags and unsafe guidance to improve evaluations.
  • Be the credible clinical voice with customers and with the physician network you recruit and calibrate.

Skills

Clinical reasoning
Evidence-based medicine
Communication skills
EHR data handling
Medical knowledge

Education

MD/DO with US residency in Internal Medicine / Family Medicine / Cardiology

Job description

Lumos AI Research in San Francisco seeks a medical doctor to lead clinical evaluation efforts for medical AI. This full-time role centers on creating gold-standard clinical cases, adjudicating expert work, and collaborating with engineers to build RL environments and verifiers that test model safety in real clinical scenarios.

You will drive the clinical quality criteria, identify model weaknesses, and serve as the credible clinical voice for customers and the physician network.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Clinical AI Evaluation & Safety Lead
Clinical AI Evaluation & Safety Lead

Lumos • San Francisco (CA)

On-site
USD 180,000 - 200,000
Senior Clinical AI Project Lead
Senior Clinical AI Project Lead

Lumos AI Research • San Francisco (CA)

On-site
USD 180,000 - 240,000
Clinical Project Lead (MD)
Clinical Project Lead (MD)

Lumos • San Francisco (CA)

On-site
USD 180,000 - 200,000
Clinical Project Lead (MD)
Clinical Project Lead (MD)

Lumos AI Research • San Francisco (CA)

On-site
USD 180,000 - 300,000
Clinical Project Lead
Clinical Project Lead

Lumos AI Research • San Francisco (CA)

On-site
USD 180,000 - 240,000
Clinical AI Product Lead (MD) - Validation & Development
Clinical AI Product Lead (MD) - Validation & Development

Lumeris, Inc. • United States

Remote
USD 203,000 - 295,000
Medical, Vision, and Dental Plans
401k with company match
Paid Time Off (PTO) and Wellness Days
Lead Applied AI Engineer: Production ML for Healthcare
Lead Applied AI Engineer: Production ML for Healthcare

present of AI • San Francisco (CA)

On-site
USD 180,000 - 260,000
Remote MD Clinical Review Lead - AI Safety & Guidelines
Remote MD Clinical Review Lead - AI Safety & Guidelines

Auraone • United States

Remote
USD 103,000 - 152,000
Remote work
Clinical AI Researcher (MD/NP/PA) - In-Person SF
Clinical AI Researcher (MD/NP/PA) - In-Person SF

Kinetic Systems • San Francisco (CA)

On-site
USD 150,000 - 230,000
Unlimited PTO
Health, dental, and vision coverage
401(k)
+1
Clinical AI & LLM Safety Lead
Clinical AI & LLM Safety Lead

neko-health • United States

On-site
USD 250,000 - 350,000