Data Scientist - Ai Evaluation

Mercor

United Kingdom

Remote

GBP 104,000 - 157,000

Part time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Mercor is seeking a Data Scientist for its Talent Network on a contract basis, working remotely. The role emphasizes designing grading criteria for data science deliverables, including ML pipelines, exploratory analyses, and robust reports.

Applicants should have at least 1 year of professional data science experience, strong Python/SQL skills, and a proven ability to communicate technical findings in writing.

Qualifications

  • 1+ years of professional data science experience.
  • Experience at a leading technology, research, or quantitative firm.
  • Strong command of Python, SQL, statistical modeling, and machine learning.
  • Exceptional written communication skills for conveying technical findings.
  • Detail-oriented and consistent approach to evaluating complex work.

Responsibilities

  • Design precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, ML pipelines, and technical reports.
  • Evaluate AI-generated or human-created work against established criteria to ensure quality and accuracy.
  • Provide detailed written justifications for evaluations and scores to maintain transparency.
  • Apply consistent, evidence-based judgment for reproducible and defensible assessments.
  • Incorporate structured feedback from senior reviewers and iterate on submitted work for continuous improvement.

Skills

Data science
Python
SQL
Statistical modeling
Machine learning
Written communication
Attention to detail

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Data Scientist Talent Network
Type: Contract
Compensation: $100–$150/hour
Location: Remote

Role Responsibilities
  • Design precise, task-specific grading criteria for data science deliverables. This includes exploratory data analyses, statistical modeling work, machine learning pipelines, and technical reports.
  • Evaluate AI-generated or human-created work against established criteria to ensure quality and accuracy.
  • Provide detailed written justifications for evaluations and scores to maintain transparency.
  • Apply consistent, evidence-based judgment for reproducible and defensible assessments.
  • Incorporate structured feedback from senior reviewers and iterate on submitted work for continuous improvement.
Qualifications
Must-Have
  • 1+ years of professional data science experience.
  • Experience at a leading technology, research, or quantitative firm.
  • Strong command of Python, SQL, statistical modeling, and machine learning.
  • Exceptional written communication skills for conveying technical findings.
  • Detail-oriented and consistent approach to evaluating complex work.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Science Expert - Evaluation Specialist
Data Science Expert - Evaluation Specialist

Mercor • United Kingdom

Remote
GBP 125,000 - 177,000
Remote Data Scientist - AI Evaluation & Quality Assurance
Remote Data Scientist - AI Evaluation & Quality Assurance

Mercor • United Kingdom

Remote
GBP 104,000 - 157,000
Senior Data Scientist & AI Evaluation (Remote)
Senior Data Scientist & AI Evaluation (Remote)

Mercor • United Kingdom

Remote
GBP 125,000 - 177,000
Software Engineering Expert - Fully Remote | Up To $180/Hr
Software Engineering Expert - Fully Remote | Up To $180/Hr

Mercor • United Kingdom

Remote
GBP 125,000 - 188,000
Communications Specialist - Fully Remote | Upto $120/Hr
Communications Specialist - Fully Remote | Upto $120/Hr

Mercor • United Kingdom

Remote
GBP 83,000 - 125,000
Single-Cell Genomics Expert - Remote | Upto $100/Hr
Single-Cell Genomics Expert - Remote | Upto $100/Hr

Mercor • United Kingdom

Remote
GBP 73,000 - 104,000
Stem Data Specialist - Engineering
Stem Data Specialist - Engineering

Mercor • England

Hybrid
GBP 21,000 - 82,000
Consulting Specialist - Fully Remote | Up To $150/Hr
Consulting Specialist - Fully Remote | Up To $150/Hr

Mercor • United Kingdom

Remote
GBP 104,000 - 157,000
Data Scientist for AI Model Evaluation (Remote)
Data Scientist for AI Model Evaluation (Remote)

Prolific • United Kingdom

Remote
GBP 49,000 - 82,000
Devops Engineer - Ai Model Evaluator
Devops Engineer - Ai Model Evaluator

Mercor • England

Hybrid
GBP 74,000 - 101,000