Location: Remote (United States / Canada)
Engagement Type: Hourly Contract
Compensation: $130-$180/hour
Commitment: 20+ hours per week
About the Opportunity
This opportunity is for experienced Medical Experts and Physicians interested in contributing to advanced AI research and evaluation projects. The role involves applying clinical expertise to design realistic patient scenarios, evaluate AI-generated medical responses against evidence-based standards, and improve how next-generation AI systems reason about patient care.
Responsibilities
- Design clinically realistic prompts and patient scenarios based on your medical specialty.
- Develop high-quality reference responses demonstrating attending-level clinical reasoning.
- Evaluate and grade AI-generated medical responses using structured evaluation criteria.
- Assess diagnostic reasoning, treatment planning, risk stratification, and guideline adherence.
- Provide detailed written feedback to improve the accuracy, safety, and quality of AI-generated medical outputs.
- Participate in onboarding and specialty calibration sessions to ensure consistent evaluation standards.
Required Qualifications
- Attending Physicians: Must be board certified with a current, active, unrestricted medical license.
- Resident Physicians: Must be in the final year of residency; recent graduates must be board-eligible.
- Fellows: Must be board-certified or board-eligible in their primary specialty and hold a current, active, unrestricted medical license.
- Strong clinical reasoning and evidence-based medical decision-making skills.
- Excellent written communication skills with exceptional attention to detail.
- Ability to work independently in a fully remote, asynchronous environment.
Relevant Specialties
This opportunity may be suitable for physicians specializing in:
- Family Medicine
- Pediatrics
- Anesthesiology
- Surgery
- Physical Medicine & Rehabilitation (PM&R)
- Occupational Medicine
- Other relevant medical specialties
- 100% remote and asynchronous.
- Default commitment of approximately 20 hours per week, with potential for additional hours based on project demand.
- Rolling start following successful onboarding.
- Ongoing engagement based on project needs and performance.
Compensation
- Competitive compensation of $130-$180/hour, based on specialty and seniority.
- Weekly payments.