Healthcare & Medical Expert

Anyone AI; Amsterdam; Remote; EUR 37,000 - 74,000; Part time

Job summary

Anyone AI Inc. is seeking Healthcare and Medical Experts to design realistic tasks for AI evaluation, drawing on deep medical expertise to create challenging, high-quality materials.

You will interpret medical information, analyze healthcare datasets, and validate outputs, contributing to reference solutions and objective evaluation criteria for AI systems.

This remote, part-time contract offers 20 hours per week for an initial two-month period, with potential extension.

Qualifications

• Medical degree or equivalent health sciences qualification.
• Experience analyzing clinical data and medical records.
• Strong English writing and clear scientific communication.

Responsibilities

• Design realistic medical tasks for AI evaluation.
• Review clinical records and documentation for accuracy.
• Analyze research findings and evidence-based guidelines.
• Validate calculations for epidemiological metrics.
• Collaborate with engineers to define reproducible tasks.
• Ensure de-identified or synthetic data usage.
• Identify inconsistencies and unsupported conclusions.
• Review AI-generated medical analyses for accuracy.

Skills

Medical terminology

Clinical data analysis

Evidence-based decision making

Analytical reasoning

Attention to detail

Written English communication

Education

Medical degree or equivalent health sciences qualification

Tools

Python

R

DICOM

EHR standards

Job description

Help shape the future of AI by designing realistic healthcare and medical tasks that challenge advanced AI agents.

• Location: Remote
• Type: Contract / Part-time
• Commitment: 20 hours/week
• Compensation: US$30-60/hour
• Project duration: 2 months, with potential extension
• Availability: Immediate start

About the role

At Anyone AI, we create high-quality training and evaluation data for frontier AI models. We’re looking for Healthcare and Medical Experts, including physicians, radiologists, clinical researchers, epidemiologists, and healthcare informatics specialists, with practical experience in clinical analysis, medical documentation, healthcare data, or medical research.

You’ll develop and validate realistic tasks that assess whether AI agents can interpret medical information, analyze healthcare datasets, identify inconsistencies, synthesize clinical evidence, and complete professional healthcare workflows.

We’re interested in experts across multiple medical specialties. Candidates are expected to demonstrate deep expertise in at least one relevant area rather than across every medical discipline.

Your expertise will help establish reliable reference solutions and meaningful evaluation criteria.

What You’ll Do

• Design realistic medical and healthcare tasks based on clinical, research, epidemiological, or healthcare administration workflows.
• Develop tasks involving medical record interpretation, clinical documentation review, and healthcare data analysis.
• Analyze clinical research findings, medical literature, and evidence-based guidelines.
• Prepare and validate calculations involving epidemiological metrics, clinical statistics, or healthcare outcomes.
• Develop tasks involving diagnostic documentation, medical coding, imaging reports, or clinical research protocols, depending on your specialization.
• Identify inconsistencies, missing information, unsupported conclusions, and errors in medical documentation.
• Create reference solutions supported by scientific evidence, documented assumptions, and reliable sources.
• Review AI-generated medical analyses and reports for accuracy, completeness, and appropriate interpretation.
• Collaborate with technical contributors to define reproducible tasks and objective evaluation criteria.
• Work with appropriately de-identified or synthetic data, following relevant privacy and confidentiality requirements.

What we’re looking for

• A medical degree, a bachelor’s degree or higher in a relevant health sciences discipline, or equivalent specialized professional qualifications.
• Substantial professional experience in at least one of the following areas: clinical medicine, radiology, epidemiology, clinical research, public health, or healthcare informatics.
• Strong understanding of medical terminology, healthcare documentation, and evidence-based decision‑making within your specialty.
• Ability to interpret clinical records, research documentation, medical datasets, or diagnostic reports.
• Experience analyzing healthcare information and identifying discrepancies or unsupported conclusions.
• Familiarity with relevant clinical, scientific, or healthcare quality standards.
• Strong analytical reasoning and attention to detail.
• Ability to communicate complex medical or scientific concepts clearly.
• Strong written English communication skills.

Nice to have

• An MD, Master’s, PhD, or relevant professional certification in a medical or healthcare discipline.
• Clinical specialization, professional medical licensure, or board certification.
• Experience with clinical trials, systematic reviews, or healthcare research.
• Familiarity with medical imaging, DICOM, electronic health records, or healthcare interoperability standards.
• Experience with medical statistics, Python, R, or healthcare data analysis tools.
• Previous experience reviewing AI-generated medical content, clinical AI applications, or medical evaluation benchmarks.