Remote Internal Medicine AI Evaluation Specialist (20h/wk)

Weekday 1; Canada; Remote; CAD 179,000 - 248,000; Part time

Job summary

Weekday 1 is seeking experienced Internal Medicine physicians to contribute to training and evaluating AI models focused on healthcare. This fully remote role involves developing realistic clinical scenarios and references, evaluating AI-generated responses, and providing feedback to improve AI reasoning in diagnosis and treatment planning.

The engagement is independent contractor-based, with a flexible schedule around 20 hours per week and weekly payments, targeting experienced clinicians

Qualifications

• Board-certified in Internal Medicine.
• Current, active, and unrestricted medical license.
• Final-year Internal Medicine resident; board-eligible for recent graduates.
• Fellows: board-certified or board-eligible in Internal Medicine or subspecialty.

Responsibilities

• Design realistic Internal Medicine clinical scenarios.
• Create attending-level reference solutions reflecting evidence-based guidelines.
• Evaluate AI-generated clinical responses using structured evaluation frameworks.
• Provide detailed written feedback to improve AI model performance and clinical reliability.
• Collaborate with clinical teams for onboarding and calibration across specialties.

Skills

Board-certified

Active medical license

Board-eligible

Education

Board-certified in Internal Medicine

Active medical license

Final-year Internal Medicine resident

Job description

Weekday 1 is seeking experienced Internal Medicine physicians to contribute to training and evaluating AI models focused on healthcare. This fully remote role involves developing realistic clinical scenarios and references, evaluating AI-generated responses, and providing feedback to improve AI reasoning in diagnosis and treatment planning.

The engagement is independent contractor-based, with a flexible schedule around 20 hours per week and weekly payments, targeting experienced clinicians