Biostatistician for AI Benchmarking — Remote Contractor

Appsierra Group

American Samoa

On-site

USD 125,000 - 208,000

Part time

5 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Remote work

Job summary

Appsierra Group is seeking experienced Biostatisticians for an advanced AI benchmarking project. You will apply your expertise in biostatistics, clinical research, and statistical methodology to help train and evaluate next-generation AI systems.

No prior AI experience is required; your domain expertise is what matters. You will design expert-level evaluation tasks, develop datasets, and craft 35+ rubric items to assess AI performance, working with stakeholders to ensure regulatory and

Qualifications

  • MS or PhD in biostatistics, statistics, epidemiology, or a closely related field
  • 4+ years of experience in pharmaceutical, contract research, hospital, or academic medical environments
  • Demonstrated command of clinical study design, regulatory documentation, and observational research methodologies
  • Advanced proficiency in R, Python, SAS, or Stata applied to real clinical or epidemiological datasets
  • Strong attention to methodological detail, clinical interpretation, and regulatory sensitivity
  • Excellent written communication skills, with the ability to author detailed grading rubrics and technical documentation

Responsibilities

  • Design and author expert-level evaluation tasks that simulate real-world biostatistics challenges
  • Develop scenarios involving clinical trial analysis, regulatory submission reviews, and observational study assessments
  • Source, construct, and curate authentic datasets for task use
  • Define appropriate methodological solutions and defensible clinical interpretations for each evaluation scenario
  • Develop comprehensive 35+ item evaluation rubrics to assess AI agent performance
  • Ensure evaluation tasks reflect the complexity, nuance, and depth of real-world biostatistics practice
  • Collaborate with project stakeholders to ensure deliverables meet regulatory and scientific standards

Skills

Biostatistics
Clinical study design
Regulatory sensitivity
Statistical programming
Communication

Education

MS/PhD in Biostatistics

Tools

R
Python
SAS
Stata

Job description

Appsierra Group is seeking experienced Biostatisticians for an advanced AI benchmarking project. You will apply your expertise in biostatistics, clinical research, and statistical methodology to help train and evaluate next-generation AI systems.

No prior AI experience is required; your domain expertise is what matters. You will design expert-level evaluation tasks, develop datasets, and craft 35+ rubric items to assess AI performance, working with stakeholders to ensure regulatory and

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Health & Medicine Benchmark Architect — Remote
Health & Medicine Benchmark Architect — Remote

Appsierra Group • American Samoa

On-site
USD 129,000 - 164,000
Remote Biomedical Informatics SME — AI Benchmark Designer
Remote Biomedical Informatics SME — AI Benchmark Designer

Turing • Austin (TX)

Remote
USD 83,000 - 152,000
Fully remote work environment
Work on cutting-edge AI projects
Potential for contract extension
+1
Remote Health & Medicine AI Benchmark Specialist
Remote Health & Medicine AI Benchmark Specialist

Appsierra Group • United States

On-site
USD 129,000 - 164,000
Remote Medical Evaluation Specialist for AI Benchmarking
Remote Medical Evaluation Specialist for AI Benchmarking

YO AI Labs • San Jose (CA)

Remote
USD 83,000 - 138,000
AI Benchmark Problem Designer: Computational Statistics
AI Benchmark Problem Designer: Computational Statistics

Obsidian • Seattle (WA)

On-site
USD 120,000 - 180,000
Remote Software Engineer, AI Benchmarking & Evaluation
Remote Software Engineer, AI Benchmarking & Evaluation

Epoch AI • United States

Remote
USD 125,000 - 200,000
Comprehensive health insurance
Flexible work environment
Generous paid time off
+1
Remote Medicine & Biostatistics Chart Analysis Specialist
Remote Medicine & Biostatistics Chart Analysis Specialist

Appsierra Group • United States

On-site
USD 34,000 - 69,000
Remote Life Sciences Research Evaluator (Contractor)
Remote Life Sciences Research Evaluator (Contractor)

Appsierra Group • American Samoa

On-site
USD 62,000 - 104,000
Remote work
Output-based compensation
AI Benchmark Designer: Computational Statistics Expert
AI Benchmark Designer: Computational Statistics Expert

Mercor • Seattle (WA)

On-site
USD 60,000 - 120,000
Senior Biostatistician — Remote, Contract
Senior Biostatistician — Remote, Contract

YO AI Labs • Seattle (WA)

Remote
USD 83,000 - 90,000