Medicine Expert - Freelance AI Trainer

Mindrift (Toloka); United States; On-site; USD 52,000 - 76,000; Part time

Job summary

Mindrift is seeking medical professionals in the United States to participate in project-based AI quality assurance. You will annotate AI-generated health content, evaluate accuracy and safety, and label outputs per clear quality standards.

You will design challenging tasks to test frontier AI systems using realistic clinical scenarios and data. You will also develop scoring schemes and alternative prompts to train AI with greater autonomy and robustness.

Qualifications

• Clinical practice experience in medical settings.
• Strong command of written English (C1 or higher).

Responsibilities

• Annotate and evaluate AI-generated health content: review clinical responses, assess medical accuracy and safety, label outputs against quality criteria.
• Create complex, realistic tasks that push frontier AI agents to their limits with scattered patient data, conditional procedures, and diagnostic reasoning.
• Build tiered task versions with objective scoring, then craft ambiguous prompts to train AI with minimal hand-holding.

Skills

Clinical practice

English proficiency

Education

Medical degree (MD/DO)

Related field with clinical training

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

Your Role & Responsibilities

What this opportunity involves

• Annotate and evaluate AI-generated health content: review responses to clinical questions, assess medical accuracy and safety, and label outputs against clear quality criteria;
• Create complex, realistic tasks that push frontier AI agents to their limits. Think scattered patient data, conditional clinical procedures, and genuine diagnostic reasoning required;
• Build a detailed version with objective scoring, then write an ambiguous version intended to train the agent to succeed with less hand-holding. Real clinical complexity only. You're improving the AI tools you'll eventually use yourself.

We're also expanding into adjacent clinical roles: nurses, psychologists, dietitians, and similar licensed professionals.

What we look for

This opportunity is a good fit for US-based medical professionals open to part-time, non-permanent projects. Ideally, contributors will have:

• Degree in Medicine, or a degree in a related field (nursing, psychology, dietetics, etc.) with clinical training that includes diagnosing and managing medical conditions;
• A current, valid US license to practice (medical license for physicians; the relevant state license for adjacent roles, such as RN, licensed psychologist, or RDN);
• Active clinical practice, with 3+ years of hands-on clinical experience (board certification is a plus);
• Strong written English (C1+);
• We welcome more experienced individuals, including specialists and senior practitioners.

Project time expectations

For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Compensation

Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks — up to the equivalent of $55/hr . Because payment is per approved task, a faster pace raises your effective hourly rate.