Senior Science & Clinical Experts - AI Benchmarking

Outlier

Österreich

On-site

EUR 56,000 - 168,000

Part time

Just now
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Outlier seeks experts to help evaluate how AI systems approach scientific and clinical work. You will design realistic problems, define verifiable outcomes, and assess proposed solutions for scientific accuracy and quality of reasoning.

Responsibilities include developing benchmarking tasks, setting criteria for judging reproducibility, and documenting errors, uncertainty, and supporting evidence.

Qualifications

  • PhD in a relevant scientific field or MD with clinical specialization.
  • At least seven years of relevant experience, including PhD and postdoctoral work; or three years with three first- or coauthored peer‑reviewed papers.
  • Clinical applicants must be PGY-4 or later, or equivalent training.
  • Comfort using a Linux terminal and having at least one authored or co-authored publication.

Responsibilities

  • Develop Linux-terminal benchmarking tasks grounded in your field, such as interpreting evidence, analyzing data or testing a scientific workflow.
  • Define how to judge whether a result is scientifically sound and reproducible.
  • Document errors, uncertainty and the evidence behind your assessment.

Skills

Publication record
Linux terminal

Education

PhD in a relevant scientific field
MD with clinical specialization

Tools

Linux terminal

Job description

Help evaluate how AI systems approach scientific and clinical work. Use your subject expertise to design realistic problems, define verifiable outcomes and evaluate proposed solutions for scientific accuracy and quality of reasoning.

What you'll work on
  • Develop Linux-terminal benchmarking tasks grounded in your field, such as interpreting evidence, analyzing data or testing a scientific workflow.
  • Define how to judge whether a result is scientifically sound and reproducible.
  • Document errors, uncertainty and the evidence behind your assessment.
Requirements
  • A completed PhD in a relevant scientific field, or an MD with a clinical specialization. Applicants must be out of current degree-program enrollment.
  • At least seven years of relevant experience, including PhD and postdoctoral work. An alternate experience route is at least three relevant years and three peer-reviewed papers as first author or coauthor.
  • Clinical applicants must be PGY-4 or later, or at an equivalent training stage. Senior residents, fellows and attendings can qualify.
  • Practical comfort using a Linux terminal and at least one authored or co-authored academic or professional publication.
Compensation and commitment

The project pays $1,350 per task, with an expected commitment of 20 hours per week for 1-6 months.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Science & Clinical AI Evaluator
Senior Science & Clinical AI Evaluator

Outlier • Austria

On-site
EUR 56,000 - 168,000
Healthcare Expert — AI Training & Evaluation
Healthcare Expert — AI Training & Evaluation

Rise Data Labs • Austria

Remote
EUR 63,000 - 188,000
Experimental Biologist & Physiologist (Lab)
Experimental Biologist & Physiologist (Lab)

AfterQuery • Austria

Remote
EUR 63,000 - 88,000
Fully remote
Flexible hours
Physics & Chemistry - AI Evaluation Expert
Physics & Chemistry - AI Evaluation Expert

Rise Data Labs • Austria

Remote
EUR 60,000 - 100,000
Senior AI Scientist (m/f/d)
Senior AI Scientist (m/f/d)

RetInSight GmbH • Wien

Hybrid
EUR 58,000 - 71,000
Hybrid work model
Central Vienna office
Public transport support
+1
CRISPR & Gene Editing Subject Matter Expert (PhD / Masters)
CRISPR & Gene Editing Subject Matter Expert (PhD / Masters)

AfterQuery • Austria

Remote
EUR 41,000 - 50,000
Healthcare Quality Specialist Expert
Healthcare Quality Specialist Expert

AfterQuery • Austria

Remote
EUR 100,000 - 150,000
Remote work
Fully async
Weekly payments via Stripe
+1
Finance Expert — AI Training & Evaluation
Finance Expert — AI Training & Evaluation

Rise Data Labs • Austria

On-site
EUR 63,000 - 125,000
Science Teacher Expert
Science Teacher Expert

AfterQuery • Austria

Remote
EUR 56,000 - 94,000
Remote work
Weekly Stripe payments
Professional rates
Remote Experimental Biologist for AI Data & Problems
Remote Experimental Biologist for AI Data & Problems

AfterQuery • Austria

Remote
EUR 63,000 - 88,000
Fully remote
Flexible hours