Remote Healthcare AI Evaluation Scientist

24-Mag Llc; New York (NY); Remote; USD 400,000 - 800,000; Full time

Benefits offered by this job

Health insurance

Paid time off

Retirement plan

Job summary

24-MAG LLC is seeking experienced researchers to lead the evaluation of healthcare-focused AI systems. The role focuses on clinical reasoning, evidence synthesis, benchmarking, and reliability analysis, with remote collaboration across clinicians and engineers.

Ideal candidates hold an advanced healthcare degree and have a track record in medical research, evidence evaluation, and interdisciplinary teamwork to advance trustworthy healthcare AI.

Qualifications

• Advanced degree in Medicine, Public Health, Nursing, Pharmacy, Biomedical Sciences, Epidemiology, Health Economics, or related field.
• Deep expertise in clinical practice, healthcare operations, biomedical research, public health, or evidence-based medicine.
• Experience with healthcare analytics or health technology assessment is beneficial.

Responsibilities

• Design healthcare AI evaluation frameworks and benchmarks.
• Analyse medical reasoning and failure patterns in healthcare AI systems.
• Develop validation protocols and clinical quality rubrics.
• Collaborate with clinicians, researchers, and engineers on evaluation tasks.
• Produce research reports and best-practice guidelines for reliability and trustworthiness.

Skills

Medical expertise

Clinical practice

Biomedical research

Healthcare analytics

Evidence evaluation

Analytical reasoning

Scientific communication

Multidisciplinary collaboration

AI evaluation

Education

MD/DO/PhD/MPH/PharmD or equivalent

Job description

24-MAG LLC is seeking experienced researchers to lead the evaluation of healthcare-focused AI systems. The role focuses on clinical reasoning, evidence synthesis, benchmarking, and reliability analysis, with remote collaboration across clinicians and engineers.

Ideal candidates hold an advanced healthcare degree and have a track record in medical research, evidence evaluation, and interdisciplinary teamwork to advance trustworthy healthcare AI.