Medical LLM Evaluator | Remote

Crossing Hurdles; United States; Remote; USD 176,000 - 251,000; Part time

Job summary

Crossing Hurdles is seeking Medical Experts to audit AI-generated medical content for clinical accuracy, safety, and relevance on a remote, contractor assignment basis. This part-time role demands 20–40 hours per week with at least 4 hours overlap during PST business hours.

You will review diagnoses, treatment plans, and clinical summaries, identify inaccuracies, and provide detailed feedback to improve AI reliability.

Qualifications

• MD or equivalent medical qualification with full US licensure.
• 1+ year of clinical experience after residency in the USA.
• Strong foundation in general medicine and evidence-based practice.
• Ability to identify inaccuracies and safety concerns in medical content.

Responsibilities

• Review AI-generated clinical content for accuracy, safety, and relevance.
• Evaluate diagnoses, treatment plans, and summaries against medical standards.
• Identify medical errors, misleading information, and patient safety risks in AI responses.
• Provide detailed clinical feedback to improve AI content reliability.

Skills

Clinical reasoning

Evidence-based medicine

Medical content review

Attention to detail

Education

MD or equivalent medical qualification

Job description

Position: Medical Experts - General Physician

Type: Contractor Assignment

Compensation: Up to $155 per hour

Location: Remote

Commitment: Part-time (20 40 hours/week), with at least 4 hours overlap during PST business hours

Role Responsibilities

• Review AI-generated medical content for clinical accuracy, safety, completeness, and relevance.
• Evaluate AI-generated diagnoses, treatment plans, and clinical summaries against evidence-based medical standards.
• Identify medical errors, misleading information, and potential patient safety risks in AI responses.
• Provide detailed clinical feedback to improve the accuracy and reliability of AI-generated medical content.

Requirements

• MD or equivalent medical qualification with full licensure to practice medicine in the USA.
• At least 1 year of clinical experience after completing medical residency, practicing medicine in the USA.
• Strong foundation in general medicine, clinical reasoning, diagnosis, and evidence-based medical practice.
• Ability to assess medical information critically and identify inaccuracies or potential safety concerns.
• Experience in medical content review, clinical research, medical annotation, or AI/ML evaluation is preferred.
• A client certification assessment is required; the assessment is paid for by Turing.