Life Sciences AI Model Trainer & Evaluator (Remote)

Norstella

United States

Remote

USD 110,000 - 160,000

Full time

15 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical benefits
HSA/FSA
Life and AD&D insurance
401k with company match
Disability insurance
Paid time off and holidays

Job summary

Norstella is seeking an Associate Life Sciences Analyst for Model Training. You will sit at the intersection of clinical and scientific expertise and applied AI development, collaborating with data scientists, operations engineers, and data engineers.

You'll focus on the preference and judgment layer of model development, calibrating outputs for quality, accuracy, and clinical reasoning so they can support actionable predictive analytics across clients.

Qualifications

  • Bachelor's degree or equivalent professional experience in life sciences, medical sciences, or computer science.
  • Experience with structured platforms and data tools; comfort with automation concepts.
  • Experience with large and complex data sets, including data cleaning or preprocessing.
  • Excellent problem-solving and independent work skills.
  • Strong communication skills across technical and non-technical teams.

Responsibilities

  • Evaluate model outputs across clinical and life sciences tasks by rating responses and rewriting outputs to show preferred results.
  • Maintain evaluation rubrics, preference dimensions, and quality criteria guiding model outputs and alignment.
  • Advise on interpretation of model behavior, bridging to dataflow inflection points with cross-functional teams.
  • Partner with data scientists and MLEs to integrate feedback into data pipelines.
  • Conduct red-team and adversarial evaluation to surface failure modes like hallucinations and citation errors.
  • Contribute to Norstella’s knowledge graph and taxonomy and help design agentic workflows.

Skills

Excellent communication
Problem solving
Independent work
Structured platforms and data tools
Data cleaning / preprocessing

Education

Bachelor's degree in life sciences / related

Tools

Automation concepts
Data preprocessing tools

Job description

Norstella is seeking an Associate Life Sciences Analyst for Model Training. You will sit at the intersection of clinical and scientific expertise and applied AI development, collaborating with data scientists, operations engineers, and data engineers.

You'll focus on the preference and judgment layer of model development, calibrating outputs for quality, accuracy, and clinical reasoning so they can support actionable predictive analytics across clients.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Associate Life Sciences Analyst, AI Model Training
Associate Life Sciences Analyst, AI Model Training

Norstella • United States

Remote
USD 110,000 - 160,000
Medical benefits
HSA/FSA
Life and AD&D insurance
+3
Senior AI Solutions Lead, Life Sciences
Senior AI Solutions Lead, Life Sciences

Norstella • United States

Hybrid
USD 110,000 - 150,000
Medical and Prescription Drug Benefits
Health Savings Accounts
Dental & Vision Benefits
+2
Senior Advisory Lead, AI Content Enablement
Senior Advisory Lead, AI Content Enablement

Norstella • Trenton (NJ)

Remote
USD 110,000 - 150,000
Medical benefits
401k with company match
Paid parental leave
Remote Senior AI Evaluation & Content Enablement Lead
Remote Senior AI Evaluation & Content Enablement Lead

Norstella • Lansing (MI)

Remote
USD 110,000 - 150,000
Medical and Prescription Drug Benefits
Health Savings Accounts (HSA) or FSA
Dental & Vision Benefits
+5
Senior AI/ML Scientist – Pharma Data, Remote
Senior AI/ML Scientist – Pharma Data, Remote

Norstella • City of Albany (NY)

Remote
USD 170,000 - 215,000
Medical and Prescription Drug Benefits
Health Savings Accounts (HSA) or FSA
Dental & Vision Benefits
+3
Senior Data Scientist — AI/ML for Pharma Solutions
Senior Data Scientist — AI/ML for Pharma Solutions

Norstella Group • United States

Remote
USD 150,000 - 210,000
Health insurance
401k with company match
Paid time off
+2
Senior Life Sciences AI Researcher (Remote, US)
Senior Life Sciences AI Researcher (Remote, US)

AI Trainer HQ • United States

Remote
USD 120,000 - 190,000
Remote AI Trainer Evaluator, Life Sciences (Contract)
Remote AI Trainer Evaluator, Life Sciences (Contract)

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Remote Senior AI Evaluation & Content Enablement Lead
Remote Senior AI Evaluation & Content Enablement Lead

Norstella • Olympia (WA)

Remote
USD 110,000 - 150,000
Medical benefits
Health Savings Account (HSA)
Dental & Vision
+4
Senior Life Sciences AI Evaluation Scientist (Remote)
Senior Life Sciences AI Evaluation Scientist (Remote)

DataAnnotation • Huntsville (AL)

Remote
USD 55,000 - 172,000