Medical Specialist

Agency; United States; Remote; USD 90,000 - 120,000; Full time

Job summary

Agency is seeking a clinical reasoning specialist to work with AI models on medical scenarios. You will review model outputs in Arabic and English, verify accuracy, and document failures to guide improvements in prompts and evaluation metrics.

The role emphasizes transparent reasoning and robust evaluation in biomedical domains. Ideal candidates have a strong medical background and fluency in Arabic and English, with expertise in internal medicine, pharmacology, pathology, or epidemiology.

Qualifications

• Strong medical background (clinical care, research, public health, or biomedical education).
• Fluency in Arabic and English.
• Expertise in internal medicine, pharmacology, pathology, or epidemiology.
• Ability to engage with complex subjects like differential diagnosis and treatment protocols.
• Clear, metacognitive communication skills.

Responsibilities

• Converse with AI models on clinical scenarios and theoretical medical questions in both Arabic and English.
• Verify factual accuracy and logical soundness of model responses.
• Capture reproducible error traces and document failure modes.
• Suggest improvements to prompt engineering and evaluation metrics.
• Articulate reasoning and decision processes explicitly to improve model reasoning.

Skills

Medical knowledge

Arabic-English fluency

Clinical reasoning

Metacognitive communication

Documentation & traceability

Education

Medical background / biomedical education

Job description

Responsibilities

• Converse with AI models on clinical scenarios and theoretical medical questions in both Arabic and English
• Verify factual accuracy and logical soundness of model responses
• Capture reproducible error traces and document failure modes
• Suggest improvements to prompt engineering and evaluation metrics
• Articulate reasoning and decision processes explicitly to improve model reasoning

Requirements

• Strong medical background (clinical care, research, public health, or biomedical education)
• Fluency in Arabic and English
• Expertise in topics such as internal medicine, pharmacology, pathology, or epidemiology
• Ability to engage with complex subjects like differential diagnosis and treatment protocols
• Clear, metacognitive communication skills

About the Company

This project focuses on developing high-quality training data to power the next generation of large-scale language models for scientific and clinical applications.