A complete application in a minute
Tailored resume and cover letter, ready to send.
SME Careers is seeking an experienced Healthcare SME for an hourly remote contractor role. You will create expert healthcare questions, design scoring rubrics, evaluate AI-generated content, and provide precise feedback to improve clinical accuracy and reliability.
The role emphasizes rubric design, expert evaluation, and high-level clinical reasoning. Applicants must have clinical credentials, strong English, and at least 3 years of experience in medicine or a related field, with a track record
In this hourly, remote contractor role, you will work as a Healthcare Subject Matter Expert (SME) to create challenging, expert-level healthcare questions, evaluate AI-generated clinical content, and design high-quality rubrics defining what an accurate, complete, and professionally appropriate answer should contain.
You will use your clinical or professional expertise to identify areas where frontier AI models may provide incomplete, inaccurate, poorly reasoned, overconfident, or clinically inadequate responses. You will write specialized questions within your field, develop detailed scoring criteria, critique rubrics created by other healthcare professionals, and provide precise written feedback.
A major focus of this role is rubric design and expert evaluation. You will define essential clinical concepts, reasoning steps, relevant caveats, acceptable alternative approaches, significant omissions, and critical errors that distinguish superficial answers from expert-level responses.
This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your healthcare expertise directly helps improve the world’s premier AI models by making their responses more accurate, clinically appropriate, rigorous, and reliable.