Radiology Specialist (Contract)

Mpathic; United States; On-site; USD 165,000 - 276,000; Full time

Job summary

mpathic.ai is seeking experienced radiologists to help evaluate the next generation of multimodal AI systems by assessing how they interpret medical images, radiology reports, and complex clinical instructions. This benchmark dataset project focuses on evaluating AI models for visual document understanding and instruction-following in the radiology domain.

You'll develop challenging, clinically realistic evaluation tasks, create expert reference answers, and identify where today's AI systems

Qualifications

• MD, DO, or internationally equivalent medical degree.
• Completion of an accredited Diagnostic Radiology residency (ACGME, AOA, or recognized international equivalent).
• Current board certification in Diagnostic Radiology (ABR, FRCPC, FRANZCR, or recognized national equivalent).
• Active, unrestricted medical license with no suspension, revocation, or ongoing disciplinary action.
• At least 3 years of independent clinical practice following residency (training years excluded), recently within past two years.
• Experience practicing in accredited or government-licensed healthcare settings (hospitals, academic medical centers, outpatient imaging centers, or private practice).

Responsibilities

• Design clinically realistic evaluation tasks using radiology images, reports, and supporting clinical documentation.
• Create expert-level prompts that assess visual document understanding, diagnostic reasoning, and instruction-following across radiology workflows.
• Evaluate AI-generated responses using structured rubrics for diagnostic accuracy, completeness, safety, and adherence to instructions.
• Identify challenging edge cases, subtle imaging findings, and common model failure modes across multiple imaging modalities.
• Provide detailed written feedback that helps improve model performance and benchmark quality.
• Collaborate directly with research teams at a leading AI lab to advance multimodal healthcare AI.
• Participate in onboarding, calibration sessions, and ongoing quality reviews.

Skills

Unrestricted medical license

Board certification in radiology

Independent clinical practice 3+ years

Education

MD, DO, or internationally equivalent medical degree

Residency in Diagnostic Radiology (ACGME, AOA, or international equivalent)

Active board certification in Diagnostic Radiology (ABR, FRCPC, FRANZCR, or national equivalent)

Job description

About mpathic.ai

mpathic is keeping humans safe in the AI era through automated tools and expert datasets that are rooted in psychology and powered by clinicians. We are a series A start-up backed by Tier 1 investors including Foundry.vc and Next Frontier Capital.

If you have applied for an expert role within the past 12 months, you do not need to reapply.

About the role

We're seeking experienced radiologists to help evaluate the next generation of multimodal AI systems by assessing how they interpret medical images, radiology reports, and complex clinical instructions. This benchmark dataset project focuses on evaluating AI models for visual document understanding and instruction-following in the radiology domain. You'll develop challenging, clinically realistic evaluation tasks, create expert reference answers, and identify where today's AI systems succeed—and where they fall short.

What You'll Do

• Design clinically realistic evaluation tasks using radiology images, reports, and supporting clinical documentation.
• Create expert-level prompts that assess visual document understanding, diagnostic reasoning, and instruction-following across radiology workflows.
• Evaluate AI-generated responses using structured rubrics for diagnostic accuracy, completeness, safety, and adherence to instructions.
• Identify challenging edge cases, subtle imaging findings, and common model failure modes across multiple imaging modalities.
• Provide detailed written feedback that helps improve model performance and benchmark quality.
• Collaborate directly with research teams at a leading AI lab to advance multimodal healthcare AI.
• Participate in onboarding, calibration sessions, and ongoing quality reviews.

Qualifications

• MD, DO, or internationally equivalent medical degree.
• Completion of an accredited Diagnostic Radiology residency (ACGME, AOA, or recognized international equivalent).
• Current board certification in Diagnostic Radiology (ABR, FRCPC, FRANZCR, or recognized national equivalent).
• Current, active, unrestricted medical license with no suspension, revocation, or ongoing disciplinary action.
• At least 3 years of independent clinical practice following residency (training years excluded), currently practicing or having practiced within the past two years.
• Experience practicing in an accredited or government-licensed healthcare setting, including hospitals, academic medical centers, outpatient imaging centers, or private practice.

Nice to have

• Currently providing at least 10 hours of direct clinical interpretation per week.
• Fellowship training or significant clinical expertise in a radiology subspecialty, including:
  • Neuroradiology
  • Musculoskeletal Radiology
  • Body Imaging
  • Breast Imaging
  • Cardiothoracic Radiology
  • Pediatric Radiology
  • Interventional Radiology
  • Emergency Radiology
• Experience interpreting multimodal imaging studies, including CT, MRI, ultrasound, mammography, nuclear medicine, and plain radiography.
• Experience reviewing AI-assisted imaging tools or participating in imaging AI research is a plus.
• Passion for advancing trustworthy AI in healthcare.

Compensation

This is a contract, project-based position. The hourly rate will depend on experience and project parameters. The rate will be disclosed prior to starting the project.