Remote Clinical AI Auditor & Model Evaluator

Medix Staffing Solutions, Inc.; United States; Remote; USD 55,000 - 172,000; Part time

Job summary

Medix Staffing Solutions, Inc. is seeking experienced healthcare clinicians to train and evaluate frontier AI models in a remote contract role. If you have independent clinical judgment and enjoy shaping AI safety and reliability, join us from anywhere in eligible regions.

You will design realistic clinical scenarios, run them through AI systems, and critically grade outputs to identify strengths and gaps, with flexible hours from 10 per week up to full-time commitments.

Qualifications

• Active clinical license in MD/DO/NP/PA/PharmD/RN or allied health with independent practice.
• Minimum 5 years of hands-on, direct clinical experience.
• Exceptional written English with ability to articulate complex medical reasoning clearly.
• Familiarity with AI/LLM tools and ability to differentiate plausible text from medically sound conclusions.

Responsibilities

• Design authentic, de-identified patient scenarios and prompts.
• Evaluate AI outputs against professional standards and identify concrete clinical failures.
• Compare outputs from identical prompts across AI models and justify the best choice.
• Develop detailed, evidence-based evaluation rubrics for correct clinical responses.
• Review and refine clinical test cases with peers across specialties.

Skills

Licensure

Clinical experience

English communication

AI/LLM tools familiarity

Analytical thinking

Job description

Medix Staffing Solutions, Inc. is seeking experienced healthcare clinicians to train and evaluate frontier AI models in a remote contract role. If you have independent clinical judgment and enjoy shaping AI safety and reliability, join us from anywhere in eligible regions.

You will design realistic clinical scenarios, run them through AI systems, and critically grade outputs to identify strengths and gaps, with flexible hours from 10 per week up to full-time commitments.