Clinical AI Evaluation & Safety Lead

Lumos

San Francisco (CA)

On-site

USD 180,000 - 200,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Lumos, based in San Francisco, builds health AI evaluation tools to ensure clinical safety and accuracy. We are seeking a medical doctor to lead the clinical quality bar across data and physician networks.

This full-time role centers on creating expert cases, adjudicating peer work, and designing RL environments to test how medical models reason under real clinical conditions, collaborating with engineers and researchers.

Qualifications

  • MD or DO with US residency in internal medicine, family medicine, or cardiology.
  • US board certification in internal medicine, cardiovascular disease, or family medicine.
  • 3+ years post-residency clinical experience, with active practice.

Responsibilities

  • Build gold-standard clinical cases and reference solutions for frontier models.
  • Review and adjudicate work of physician experts; define quality standards.
  • Design and ship RL environments and verifiers for clinical agents.
  • Stress-test models to find hallucinations, red flags, and unsafe guidance; improve evaluations.
  • Be the credible clinical voice with customers and the physician network.

Skills

Clinical expertise
Evidence-based medicine
Clinical communication
Structured data & EHR concepts

Education

MD/DO from an accredited program
US residency in Internal Medicine, Family Medicine or Cardiology
US board certification in Internal Medicine / Cardiology / Family Medicine
3+ years of post-residency clinical experience

Job description

Lumos, based in San Francisco, builds health AI evaluation tools to ensure clinical safety and accuracy. We are seeking a medical doctor to lead the clinical quality bar across data and physician networks.

This full-time role centers on creating expert cases, adjudicating peer work, and designing RL environments to test how medical models reason under real clinical conditions, collaborating with engineers and researchers.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Clinical AI Lead - MD, Medical AI Evaluation
Clinical AI Lead - MD, Medical AI Evaluation

Lumos AI Research • San Francisco (CA)

On-site
USD 180,000 - 300,000
Senior Clinical AI Project Lead
Senior Clinical AI Project Lead

Lumos AI Research • San Francisco (CA)

On-site
USD 180,000 - 240,000
Clinical Project Lead (MD)
Clinical Project Lead (MD)

Lumos • San Francisco (CA)

On-site
USD 180,000 - 200,000
Clinical Project Lead (MD)
Clinical Project Lead (MD)

Lumos AI Research • San Francisco (CA)

On-site
USD 180,000 - 300,000
Clinical Project Lead
Clinical Project Lead

Lumos AI Research • San Francisco (CA)

On-site
USD 180,000 - 240,000
Clinical AI Product Lead (MD) - Validation & Development
Clinical AI Product Lead (MD) - Validation & Development

Lumeris, Inc. • United States

Remote
USD 203,000 - 295,000
Medical, Vision, and Dental Plans
401k with company match
Paid Time Off (PTO) and Wellness Days
Senior AI Engineer & Platform Lead
Senior AI Engineer & Platform Lead

Luminai • San Mateo (CA)

Hybrid
USD 200,000 - 350,000
Lead Applied AI Engineer: Production ML for Healthcare
Lead Applied AI Engineer: Production ML for Healthcare

present of AI • San Francisco (CA)

On-site
USD 180,000 - 260,000
Clinical AI & LLM Safety Lead
Clinical AI & LLM Safety Lead

neko-health • United States

On-site
USD 250,000 - 350,000
Senior RL Scientist - Healthcare AI Safety
Senior RL Scientist - Healthcare AI Safety

Hippocratic AI Inc. • Menlo Park (CA)

On-site
USD 180,000 - 240,000