Pharmacist AI Evaluation Subject Matter Expert

OpenTrain AI, Inc.; United States; Remote; USD 48,000 - 90,000; Part time

Job summary

OpenTrain AI, Inc. is seeking an experienced pharmacist to remotely review and improve AI-generated medication responses. You will assess pharmacotherapy, dosing, safety, and patient counseling, and provide expert feedback to strengthen model outputs.

Responsibilities include writing gold-standard answers, assessing multiple AI outputs, and ensuring accuracy across diverse patient populations. This is a part-time remote contractor role requiring at least 5 years of practice and a valid license.

Qualifications

• PharmD or pharmacy degree and active pharmacist licensure or eligibility.
• At least 5 years of professional pharmacy practice.
• Strong grounding in pharmacology, therapeutics, medication safety, and patient care workflows.

Responsibilities

• Review AI medication and pharmacy answers for accuracy, safety, clarity, and prompt adherence.
• Identify errors in indication, dosing, interactions, monitoring, and counseling.
• Write explanations and model answers showing correct clinical reasoning.
• Rate and compare AI responses for correctness, safety, and reasoning quality.
• Create prompts and gold-standard pharmacy responses for therapeutics and safety topics.
• Check timelines, dosing units, lab interpretation, and medication reconciliation details.

Skills

Clinical judgment

Attention to detail

Pharmacology knowledge

Clear written feedback

English proficiency

Education

PharmD or Bachelors/Masters in Pharmacy

Tools

None

Job description

The work

You will evaluate AI-generated medication and pharmacy responses and help improve their clinical reasoning. Your work will cover pharmacotherapy, dosing, contraindications, drug interactions, monitoring, patient counseling, medication safety, and written feedback.

You will also create expert pharmacy content, write gold-standard answers, compare model responses, and test outputs for unsafe recommendations, misleading assumptions, bias, and errors across patient populations and use cases.

• Review AI medication and pharmacy answers for accuracy, clarity, safety, and adherence to the prompt.
• Find errors in indication selection, dosing, titration, interactions, monitoring, contraindications, counseling, and deprescribing.
• Write clear explanations and model answers that show correct clinical reasoning.
• Rate and compare multiple AI responses for correctness, safety, internal consistency, and reasoning quality.
• Create detailed prompts and gold-standard pharmacy responses for therapeutics and medication safety topics.
• Check timelines, physiology, dosing units, formulation choices, lab interpretation, and medication reconciliation details.

What it pays and takes

This is a remote, hourly contractor role for an experienced pharmacy professional. The work requires careful clinical judgment, strong attention to detail, and a focus on patient safety.

• Pay: $35 to $65 USD per hour.
• Time: 20+ hours per week.
• Work arrangement: Remote, part-time contractor.
• Location: Applicants must be based in Bangladesh, Bhutan, Brazil, Cambodia, Germany, India, Indonesia, Malaysia, Nepal, Pakistan, Singapore, Sri Lanka, Thailand, the Philippines, the United States, Timor-Leste, or Vietnam.
• Language: Minimum C1 English proficiency.
• Education and license: PharmD or a bachelor's or master's degree in Pharmacy, with active pharmacist licensure or eligibility.
• Experience: At least 5 years of professional pharmacy practice.
• Knowledge: Strong grounding in pharmacology, therapeutics, medication safety, guideline-based therapy, medication reconciliation, and patient care workflows.
• Preferred experience: AI data training, medication-use evaluation, drug information, clinical documentation review, PBM or managed care review, or healthcare editorial quality assurance.
• Helpful background: Community, hospital, ambulatory care, clinical pharmacy, managed care, or similar practice experience.
• Work style: Reliable, self-directed, and comfortable working hourly across time zones.

About AI training work

AI training is the human work behind systems that generate answers and make decisions. Pharmacy experts review examples, explain what is correct, and flag unsafe reasoning so AI models can produce more reliable medication information.