Physician AI Quality Annotator (Part-Time)

Mindrift; Colorado; On-site; USD 198,000 - 331,000; Part time

Job summary

Mindrift seeks US-based practicing physicians to contribute to health-focused AI training projects on a part-time, non-permanent basis. You will annotate and evaluate AI-generated clinical responses, assess medical accuracy and safety, and label outputs against clear quality criteria.

Projects involve building complex tasks, scoring systems, and creating variants to train agents for realistic clinical reasoning. Licensure and clinical experience are essential for participation.

Qualifications

• Need medical licensure (where applicable) and clinical training.
• Excellent written communication skills in English.
• Experience reviewing medical content and assessing safety and accuracy.
• Familiarity with medical terminology and documentation standards.
• Open to part-time, non-permanent project work.

Responsibilities

• Annotate and evaluate AI-generated health content for accuracy and safety.
• Create complex tasks that test AI agents with realistic clinical scenarios.
• Develop scoring frameworks and variants to train AI models with less hand-holding.

Skills

Strong written English

Clinical experience

Education

MD or equivalent (Medicine) with clinical training

Job description

Mindrift seeks US-based practicing physicians to contribute to health-focused AI training projects on a part-time, non-permanent basis. You will annotate and evaluate AI-generated clinical responses, assess medical accuracy and safety, and label outputs against clear quality criteria.

Projects involve building complex tasks, scoring systems, and creating variants to train agents for realistic clinical reasoning. Licensure and clinical experience are essential for participation.