Senior Science & Clinical Experts - AI Benchmarking

Braintrust; United States; Remote; USD 55,000 - 77,000; Part time

Job summary

Senior Science & Clinical Experts - AI Benchmarking is seeking experts to design Linux-terminal benchmarking tasks grounded in scientific fields. You will define criteria to judge whether results are scientifically sound and reproducible, and you will document errors, uncertainties, and the evidence behind assessments.

The role requires a completed PhD or MD with clinical specialization, 7+ years of experience or an alternate path with 3 peer-reviewed papers, and practical comfort using a Linux

Qualifications

• Completed PhD in a relevant scientific field or an MD with clinical specialization.
• At least seven years of relevant experience, including PhD and postdoctoral work.
• Clinical applicants must be PGY-4 or later, or equivalent training.
• Comfort using a Linux terminal and having at least one publication.

Responsibilities

• Develop Linux-terminal benchmarking tasks grounded in your field.
• Define criteria to judge scientific soundness and reproducibility.
• Document errors, uncertainty, and evidence behind assessments.

Skills

Linux terminal

Scientific data interpretation

Evidence-based evaluation

Quality assessment of workflows

Education

PhD in a relevant scientific field

MD with clinical specialization

Job description

• Rate: $1,350/task
• Hours: 20 hours / week
• Experience: 3 - 5 years
• Location: United States | Canada + 23 more

Help evaluate how AI systems approach scientific and clinical work. Use your subject expertise to design realistic problems, define verifiable outcomes and evaluate proposed solutions for scientific accuracy and quality of reasoning.

What you’ll work on

• Develop Linux-terminal benchmarking tasks grounded in your field, such as interpreting evidence, analyzing data or testing a scientific workflow.
• Define how to judge whether a result is scientifically sound and reproducible.
• Document errors, uncertainty and the evidence behind your assessment.

Requirements

• A completed PhD in a relevant scientific field, or an MD with a clinical specialization. Applicants must be out of current degree-program enrollment.
• At least seven years of relevant experience, including PhD and postdoctoral work. An alternate experience route is at least three relevant years and three peer-reviewed papers as first author or coauthor.
• Clinical applicants must be PGY-4 or later, or at an equivalent training stage. Senior residents, fellows and attendings can qualify.
• Practical comfort using a Linux terminal and at least one authored or co-authored academic or professional publication.

Compensation and commitment

The project pays $1,350 per task, with an expected commitment of 20 hours per week for 1-6 months.

Company: Senior Science & Clinical Experts - AI Benchmarking
Location: Any time