Life Sciences AI Evaluation Task Designer

OpenTrain AI, Inc.; Northern (KY); Hybrid; USD 90,000 - 130,000; Full time

Job summary

OpenTrain is seeking a Life Sciences AI Evaluation Task Designer to create challenging benchmark tasks that help evaluate how AI systems reason about real scientific work. You will use authentic research artifacts and technical challenges to represent advanced life sciences practice, including experimental design critique, protocol analysis, primary data interpretation, and methodological judgment.

You will source and synthesize data, define the correct methodological approach, and build

Qualifications

• Bachelor's or master's in biology, biomedical sciences, biochemistry, or closely related field.
• At least 2 years of hands-on research with primary data analysis.
• Experience with protocol-driven, multi-source scientific workflows and documenting results.
• Strong written English and ability to evaluate scientific literature.

Responsibilities

• Develop complex research evaluation tasks in biology or related life sciences.
• Source and synthesize raw experimental data, protocols, literature, and supplementary documents.
• Define the correct methodological approach and document the biological interpretation for each task.
• Build multi-item rubrics assessing rigor, data interpretation, and fidelity to sources.
• Ensure task scenarios capture ambiguity, nuance, and depth of real-world science.
• Collaborate asynchronously with coordinators to refine deliverables and maintain objective evaluation standards.

Skills

Scientific reasoning

Source synthesis

Methodological evaluation

Written English

Data interpretation

Education

Bachelor's or Master’s in Life Sciences

Job description

About OpenTrain

OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role

OpenTrain is recruiting for a Life Sciences AI Evaluation Task Designer to create challenging benchmark tasks that help evaluate how AI systems reason about real scientific work. You will use authentic research artifacts and technical challenges to represent advanced life sciences practice, including experimental design critique, protocol analysis, primary data interpretation, and methodological judgment. The work is designed around realistic datasets, multi-step problem solving, and detailed evaluation standards rather than simplified textbook exercises.

What you will do

Develop complex research evaluation tasks in biology, biomedical science, biochemistry, or a related life sciences discipline. Source and synthesize raw experimental data, laboratory protocols, technical literature, and supplementary documents. Define the correct methodological approach and document the appropriate biological interpretation for each task. Build multi-item rubrics that assess methodological rigor, data interpretation, and fidelity to source materials. Ensure task scenarios capture ambiguity, nuance, and the depth of real-world scientific work. Collaborate asynchronously with coordinators to refine deliverables and maintain objective, high-quality task design.

Required skills

A bachelor's or master's degree in biology, biomedical sciences, biochemistry, or a closely related field. At least two years of hands-on research or laboratory experience involving primary data analysis and scientific protocols. Demonstrated ability to work through protocol-driven, multi-source scientific workflows. Strong scientific reasoning, source synthesis, methodological evaluation, and written English skills. Experience drafting or reviewing scientific documentation and handling CSVs, spreadsheets, PDFs, and technical documents. Careful attention to rubric fidelity and objective evaluation criteria.

Why work with OpenTrain

OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.