Remote Clinical AI Evaluator & Scenario Designer

Aston Carter; New York (NY); Remote; USD 55,000 - 172,000; Full time

Benefits offered by this job

PayPal payment

Flexible schedule

Job summary

Aston Carter is seeking experienced healthcare professionals to join a remote contract role as a Medical AI Trainer. You will evaluate AI outputs, create realistic clinical scenarios, and develop evaluation criteria to ensure accuracy and safety.

Ideal candidates bring hands-on clinical experience, strong documentation skills, and the ability to articulate reasoning in writing. The role offers flexible scheduling and project-based workload with compensation via PayPal.

Qualifications

• 2+ years of current or recent clinical experience preferred.
• Active or recent healthcare license.
• Strong clinical judgment and critical-thinking skills.
• Excellent written communication skills and attention to detail.
• Ability to identify clinical errors and explain reasoning clearly.
• Familiarity with evidence-based standards and best practices.

Responsibilities

• Create realistic clinical scenarios based on your professional experience.
• Develop patient cases, supporting documentation, and evaluation criteria.
• Review AI-generated clinical notes, assessments, treatment plans, discharge summaries, and patient education materials.
• Compare multiple AI responses and identify inaccuracies, omissions, reasoning errors, and safety concerns.
• Create detailed grading rubrics that define what a clinically appropriate response should include.
• Provide written feedback explaining why responses meet or fail professional standards.
• Review and refine healthcare tasks developed by other clinical professionals.

Skills

Clinical judgment

Critical thinking

Written communication

Chart-review experience

Education

Bachelor's degree or higher

Tools

ChatGPT

Claude

Job description

Aston Carter is seeking experienced healthcare professionals to join a remote contract role as a Medical AI Trainer. You will evaluate AI outputs, create realistic clinical scenarios, and develop evaluation criteria to ensure accuracy and safety.

Ideal candidates bring hands-on clinical experience, strong documentation skills, and the ability to articulate reasoning in writing. The role offers flexible scheduling and project-based workload with compensation via PayPal.