Remote Medical AI Evaluation Scientist

Pro Integrate LLC; New York (NY); Remote; USD 200,000 - 250,000; Full time

Benefits offered by this job

Equity compensation

Health-insurance premium reimbursement

Paid time off

401(k) with company match

Job summary

Pro Integrate LLC is seeking a Member of Technical Staff, Medical & Health Research to advance AI systems for healthcare, clinical, and biomedical workflows. You will design rigorous evaluation frameworks to measure medical reasoning, evidence synthesis, and decision support capabilities.

The role emphasizes applied research, quality standards, and shaping trustworthy AI in healthcare. You will collaborate with clinicians, researchers, and engineers, develop benchmarks and reports, and stay

Qualifications

• Advanced degree in a healthcare field (MD/DO/PhD/MPH/PharmD).
• Experience in medical or healthcare research.
• Strong design and evaluation knowledge.
• Excellent analytical and scientific communication skills.

Responsibilities

• Design and own evaluation frameworks for AI systems operating in healthcare and medical domains, including benchmarks, scoring methodologies, clinical quality rubrics, and validation protocols.
• Conduct research on medical reasoning, evidence-based decision making, clinical workflows, and healthcare information synthesis.
• Develop benchmark datasets and evaluation environments based on real-world healthcare and biomedical scenarios.
• Collaborate with researchers, clinicians, and engineers to evaluate and improve healthcare-focused AI systems.
• Analyze performance, safety considerations, reasoning quality, and failure patterns in medical use cases.
• Produce research reports, evaluation methodologies, and best-practice guidelines.
• Stay current with advancements in medicine, healthcare delivery, biomedical research, and AI.
• Contribute to the development of industry standards for healthcare AI evaluation and reliability.

Skills

Analytical reasoning

Scientific communication

Research design

Multidisciplinary collaboration

Education

Advanced healthcare degree (MD/DO/PhD/MPH/PharmD)

Job description

Pro Integrate LLC is seeking a Member of Technical Staff, Medical & Health Research to advance AI systems for healthcare, clinical, and biomedical workflows. You will design rigorous evaluation frameworks to measure medical reasoning, evidence synthesis, and decision support capabilities.

The role emphasizes applied research, quality standards, and shaping trustworthy AI in healthcare. You will collaborate with clinicians, researchers, and engineers, develop benchmarks and reports, and stay