Remote Internal Medicine AI Evaluation Specialist

Weekday AI (YC W21); United States; On-site; USD 186,252,000 - 257,887,000; Part time

Job summary

Weekday AI (YC W21) seeks experienced Internal Medicine physicians for training and evaluating AI models in healthcare. This fully remote, independent contractor role involves designing realistic clinical scenarios and producing attending-level reference solutions aligned with current guidelines.

You will review AI outputs, provide detailed feedback, and collaborate with clinical teams to improve AI reasoning in diagnosis and management.

Qualifications

• Board-certified in Internal Medicine with active medical license.
• Experienced physician (attending, resident, or fellow) in Internal Medicine.
• Familiarity with AI or clinical decision support is a plus.

Responsibilities

• Design Clinical Scenarios: Create realistic Internal Medicine case studies.
• Create Reference-Quality Responses: Produce attending-level solutions aligned with guidelines.
• Evaluate AI Performance: Review AI outputs and provide detailed feedback.
• Collaborate with Clinical Teams: Engage in onboarding and calibration with colleagues.

Skills

Internal Medicine

Board-certified

Medical license

Education

MD/DO (US medical degree)

Job description

Weekday AI (YC W21) seeks experienced Internal Medicine physicians for training and evaluating AI models in healthcare. This fully remote, independent contractor role involves designing realistic clinical scenarios and producing attending-level reference solutions aligned with current guidelines.

You will review AI outputs, provide detailed feedback, and collaborate with clinical teams to improve AI reasoning in diagnosis and management.