Biostatistics AI Benchmarking Specialist

OpenTrain AI, Inc.; Northern (KY); Hybrid; USD 83,000 - 165,000; Full time

Job summary

OpenTrain AI, Inc. is seeking a Biostatistics AI Evaluation Expert to create rigorous evaluation content for AI benchmarking and training. You will translate real-world biostatistical challenges into expert tasks and curate clinical materials for validation.

This individual contractor role combines advanced biostatistics with structured evaluation of AI performance, including developing rubrics and ensuring alignment with regulatory and scientific standards.

Qualifications

• Advanced degree in biostatistics, epidemiology, or related field.
• Experience translating biostatistical problems into evaluative tasks and rubrics.
• Familiarity with regulatory submission practices is a plus.

Responsibilities

• Design evaluation scenarios covering clinical trials, regulatory submission review, and observational study assessment.
• Source and curate trial data, patient records, and protocol documents for evaluation tasks.
• Define analytical approaches and defensible interpretations for AI benchmarking.
• Develop rubrics with 35+ criteria to evaluate AI agent performance.
• Ensure tasks reflect professional biostatistics complexity and regulatory sensitivity.
• Collaborate with stakeholders to align deliverables with regulatory and scientific standards.

Skills

Biostatistics

Epidemiology

Regulatory knowledge

Technical writing

Rubric development

Contract research experience

Education

MS or PhD in biostatistics/epidemiology

Tools

R

Python

SAS

Stata

Job description

OpenTrain AI, Inc. is seeking a Biostatistics AI Evaluation Expert to create rigorous evaluation content for AI benchmarking and training. You will translate real-world biostatistical challenges into expert tasks and curate clinical materials for validation.

This individual contractor role combines advanced biostatistics with structured evaluation of AI performance, including developing rubrics and ensuring alignment with regulatory and scientific standards.