Senior Science & Clinical Experts - AI Benchmarking

Outlier

New Zealand

On-site

NZD 83,000 - 103,000

Full time

10 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Outlier is seeking a highly qualified investigator to design and assess benchmarking tasks in AI-driven scientific evaluation. You will design tasks grounded in your field, specify verifiable outcomes, and assess solutions for scientific accuracy and reasoning quality.

The role requires a PhD (or MD with clinical specialization), extensive publication experience, and comfort using a Linux terminal. Contract work spans 1–6 months with an expected 20 hours per week.

Qualifications

  • PhD in a relevant scientific field, or MD with clinical specialization.
  • Seven years of relevant experience, including PhD and postdoctoral work; or three years plus three first/coauthor publications.
  • Clinicians must be PGY-4 or higher or equivalent training.
  • Practical comfort using a Linux terminal and at least one publication.

Responsibilities

  • Develop Linux-terminal benchmarking tasks grounded in your field.
  • Define how to judge whether results are scientifically sound and reproducible.
  • Document errors, uncertainty and the evidence behind assessment.

Skills

Linux terminal
Scientific evaluation
Literature analysis
Publication experience

Education

PhD in relevant field
MD with clinical specialization

Job description

Help evaluate how AI systems approach scientific and clinical work. Use your subject expertise to design realistic problems, define verifiable outcomes and evaluate proposed solutions for scientific accuracy and quality of reasoning.

What you'll work on
  • Develop Linux-terminal benchmarking tasks grounded in your field, such as interpreting evidence, analyzing data or testing a scientific workflow.
  • Define how to judge whether a result is scientifically sound and reproducible.
  • Document errors, uncertainty and the evidence behind your assessment.
Requirements
  • A completed PhD in a relevant scientific field, or an MD with a clinical specialization. Applicants must be out of current degree-program enrollment.
  • At least seven years of relevant experience, including PhD and postdoctoral work. An alternate experience route is at least three relevant years and three peer-reviewed papers as first author or coauthor.
  • Clinical applicants must be PGY-4 or later, or at an equivalent training stage. Senior residents, fellows and attendings can qualify.
  • Practical comfort using a Linux terminal and at least one authored or co-authored academic or professional publication.
Compensation and commitment

The project pays $1,350 per task, with an expected commitment of 20 hours per week for 1-6 months.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Science & Clinical Expert — AI Evaluation
Senior Science & Clinical Expert — AI Evaluation

Outlier • New Zealand

On-site
NZD 83,000 - 103,000
Physician (Md/Do) - Put Medical Ai To The Test, Remote
Physician (Md/Do) - Put Medical Ai To The Test, Remote

Mindrift • New Zealand

Remote
NZD 124,000 - 199,000
Onboarding reward
Senior Media, Audio & Linguistics Experts - AI Benchmarking
Senior Media, Audio & Linguistics Experts - AI Benchmarking

Braintrust • New Zealand

Remote
NZD 55,000 - 68,000
Physician (Md/Do) - Medical Ai Evaluation
Physician (Md/Do) - Medical Ai Evaluation

Mindrift • New Zealand

Remote
NZD 192,000 - 320,000
Radiologist / Radiation Sciences Expert (AI Safety)
Radiologist / Radiation Sciences Expert (AI Safety)

AfterQuery • New Zealand

Remote
NZD 165,000 - 248,000
Remote work
Flexible schedule
Task-based work
Healthcare Professional Sme - Ai Evaluator
Healthcare Professional Sme - Ai Evaluator

Volga Partners • New Zealand

Remote
NZD 37,000 - 87,000
Senior Media & Audio AI Benchmark Specialist
Senior Media & Audio AI Benchmark Specialist

Braintrust • New Zealand

Remote
NZD 55,000 - 68,000
Medical Student & Healthcare Trainee - AI Evaluator (New Zealand)
Medical Student & Healthcare Trainee - AI Evaluator (New Zealand)

Volga Partners • New Zealand

Remote
NZD 37,000 - 85,000
Radiologist - AI Trainer
Radiologist - AI Trainer

AfterQuery Experts • New Zealand

Remote
NZD 310,000 - 442,000
Remote Medical Trainee — Help Shape AI in Healthcare
Remote Medical Trainee — Help Shape AI in Healthcare

Volga Partners • New Zealand

Remote
NZD 37,000 - 85,000
Top locations