Radiology AI Evaluation Specialist — Remote Contract

mercor; San Francisco (CA); Hybrid; CAD 62,000 - 76,000; Part time

Job summary

Mercor is seeking a Radiology — Visual Document Understanding contractor to evaluate AI-generated content in the radiology domain, crafting grounded tasks and clear rubrics. This remote, part-time role requires 15–20 hours per week.

You will collaborate with radiology experts to ensure coverage, consistency, and rigor across datasets, and contribute to model evaluation and data-quality improvements while meeting deadlines.

Qualifications

• Expertise in the Radiology domain.
• Experience with AI model evaluation and visual document understanding.

Responsibilities

• Evaluate the accuracy and depth of AI-generated content in the Radiology domain to strengthen reasoning and rigor in model outputs.
• Author complex, grounded tasks with a clear ground-truth output and objective rubric.
• Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Radiology domain expertise

AI model evaluation

Visual document understanding

Job description

Mercor is seeking a Radiology — Visual Document Understanding contractor to evaluate AI-generated content in the radiology domain, crafting grounded tasks and clear rubrics. This remote, part-time role requires 15–20 hours per week.

You will collaborate with radiology experts to ensure coverage, consistency, and rigor across datasets, and contribute to model evaluation and data-quality improvements while meeting deadlines.