General Physician (AI Evaluation)

Gramian Consulting Group; United States; Remote; USD 110,000 - 165,000; Part time

Job summary

Gramian Consultancy is seeking licensed physicians currently practicing in the United States to support evaluation and improvement of AI systems in healthcare. You will review AI-generated clinical content for medical accuracy, safety, completeness, and relevance, applying clinical judgment to identify errors and unsafe recommendations.

This is a contractor assignment for 12 weeks with flexible part-time or full-time commitments (20-40h/week).

Qualifications

• MD or equivalent medical qualification required.
• Must be fully licensed to practice medicine in the United States.
• Currently actively practicing medicine in the US.
• At least 1 year of post-residency clinical experience.
• Strong general clinical judgment expected.

Responsibilities

• Review AI-generated medical content for accuracy, safety, and completeness.
• Evaluate diagnoses, treatment plans, case summaries, and clinical reasoning.
• Identify inaccurate, unsafe, misleading, or incomplete medical outputs.
• Provide structured expert feedback to improve model quality.
• Collaborate with clinical and AI teams on quality improvement.
• Follow detailed evaluation guidelines and complete structured questionnaires.

Education

MD (Medical Doctor) or equivalent

Fully licensed to practice in the United States

Currently actively practicing medicine in the US

At least 1 year of post-residency clinical practice

Strong general clinical judgment

Job description

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role Overview

We are looking for licensed physicians currently practicing in the United States to support the evaluation and improvement of advanced AI systems in healthcare.

The role involves reviewing AI-generated clinical content for medical accuracy, safety, completeness, and relevance, including diagnoses, treatment plans, summaries, and other case-based outputs. You will apply real-world clinical judgment to identify errors, unsafe recommendations, missing information, and weak reasoning, helping improve the quality and reliability of medical AI systems.

CONTRACT: Contractor assignment, 12 weeks

COMMITMENT: Part-time or Full-time (20-40h/week)

LOCATIONS: Remote - USA

PROCESS: The selection will be made based on an online questionnaire and resume/education/certification

NOTES: Candidates must be fully licensed and actively practicing medicine in the US.

Key Responsibilities

• Review AI-generated medical content for accuracy, safety, and completeness.
• Evaluate diagnoses, treatment plans, case summaries, and clinical reasoning.
• Identify inaccurate, unsafe, misleading, or incomplete medical outputs.
• Apply evidence-based medical standards and professional clinical judgment.
• Provide structured expert feedback to improve model quality.
• Follow detailed evaluation and annotation guidelines.
• Complete structured questionnaires and reviews using web-based tools.
• Collaborate with clinical and AI teams on quality improvement.

• Medical Doctor (MD) or equivalent medical qualification such as MBBS, MBChB, or equivalent.
• Fully licensed to practice medicine in the United States.
• Currently actively practicing medicine in the US.
• At least 1 year of post-residency clinical practice experience as a physician.
• Strong general clinical judgment; no specific specialty is required.