Biostatistics AI Evaluation Expert

OpenTrain AI, Inc.; Northern (KY); Hybrid; USD 83,000 - 165,000; Full time

Job summary

OpenTrain AI, Inc. is seeking a Biostatistics AI Evaluation Expert to create rigorous evaluation content for AI benchmarking and training. You will translate real-world biostatistical challenges into expert tasks and curate clinical materials for validation.

This individual contractor role combines advanced biostatistics with structured evaluation of AI performance, including developing rubrics and ensuring alignment with regulatory and scientific standards.

Qualifications

• Advanced degree in biostatistics, epidemiology, or related field.
• Experience translating biostatistical problems into evaluative tasks and rubrics.
• Familiarity with regulatory submission practices is a plus.

Responsibilities

• Design evaluation scenarios covering clinical trials, regulatory submission review, and observational study assessment.
• Source and curate trial data, patient records, and protocol documents for evaluation tasks.
• Define analytical approaches and defensible interpretations for AI benchmarking.
• Develop rubrics with 35+ criteria to evaluate AI agent performance.
• Ensure tasks reflect professional biostatistics complexity and regulatory sensitivity.
• Collaborate with stakeholders to align deliverables with regulatory and scientific standards.

Skills

Biostatistics

Epidemiology

Regulatory knowledge

Technical writing

Rubric development

Contract research experience

Education

MS or PhD in biostatistics/epidemiology

Tools

R

Python

SAS

Stata

Job description

About OpenTrain

OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role

OpenTrain is recruiting a Biostatistics AI Evaluation Expert to create rigorous evaluation content for AI benchmarking and training. You will turn real-world biostatistical challenges into expert-level tasks, curate clinical and research materials, establish defensible solutions, and assess whether AI systems demonstrate sound methodology and clinical reasoning. This role combines advanced biostatistics practice with structured evaluation of AI performance.

What you will do

• Design scenarios covering clinical trial analysis, regulatory submission review, and observational study assessment.
• Source, construct, and curate trial data, patient records, and protocol documents for evaluation tasks.
• Define correct analytical approaches, methodological solutions, and defensible clinical interpretations.
• Develop comprehensive rubrics containing 35 or more criteria for evaluating AI agent performance.
• Ensure tasks reflect the complexity of professional biostatistics rather than simplified textbook examples.
• Collaborate with stakeholders to align deliverables with regulatory and scientific standards.

Required skills

• Advanced expertise in biostatistics, statistics, or epidemiology, supported by an MS or PhD.
• At least four years of experience in pharmaceutical, contract research, hospital, or academic medical settings.
• Strong command of clinical study design, regulatory documentation, and observational research methods.
• Advanced proficiency in R, Python, SAS, or Stata applied to clinical or epidemiological datasets.
• Excellent technical writing and the ability to author detailed grading rubrics and documentation.
• Careful judgment regarding methodological rigor, clinical interpretation, and regulatory sensitivity.

Helpful background

Experience preparing submission-ready deliverables for agencies such as the FDA or EMA is helpful. Familiarity with complex clinical datasets and the ability to distinguish scientifically defensible conclusions from weak or incomplete reasoning will support success in this work.

Working arrangement

This is an individual contractor opportunity supporting specialized expert evaluation for an AI training portfolio. The work involves structured tasks whose requirements may vary with project needs and task complexity.

Why work with OpenTrain

OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.