Healthcare AI Evaluation Specialist (Remote)

Patronus AI, Inc.; United States; Remote; USD 69,000 - 207,000; Part time

Benefits offered by this job

Remote work

Job summary

Patronus AI, Inc. is seeking independent contractor clinicians to design and solve realistic healthcare tasks for AI evaluation. You will create records from scenarios, craft requests, provide solutions with reasoning, and define grading rubrics for training data.

You can work remotely from the US on a rolling start, with tasks paid per hour or per completed task depending on project. No AI background is required, but attention to medical detail and professional English writing are essential.

Qualifications

• 3+ years hands-on experience in at least one of the clinical areas listed.
• Current or past licensure or certification in your field (MD/DO/NP/PA/RN/PharmD/CPC/CCS).
• Working knowledge of guidelines, criteria, and documentation standards in your area.
• Careful reading with evidence behind conclusions.
• Clear, precise writing in professional English.
• Ability to work independently and asynchronously against deadlines.

Responsibilities

• Build realistic, fully fictional patient and operational records from provided scenarios.
• Write task requests that state deliverables and handling of uncertainty.
• Solve each task end to end and document a reference solution with reasoning.
• Write scoring criteria precise enough for consistent grading.
• Check tasks for clinical accuracy and ambiguity.
• Work with reviewer feedback within agreed turnaround times.
• Explain to the research team how work is done in practice.
• Review scenarios and documents for realism.

Skills

Clinical experience

Attention to detail

Independent work

Asynchronous work

Education

Licensed clinician (MD/DO/NP/PA/RN/PharmD)

Job description

Patronus AI, Inc. is seeking independent contractor clinicians to design and solve realistic healthcare tasks for AI evaluation. You will create records from scenarios, craft requests, provide solutions with reasoning, and define grading rubrics for training data.

You can work remotely from the US on a rolling start, with tasks paid per hour or per completed task depending on project. No AI background is required, but attention to medical detail and professional English writing are essential.