Contract Data Scientist Talent Evaluator - Remote

Mercor; Greater London; Remote; GBP 103,000 - 154,000; Part time

Job summary

Mercor is expanding its data science talent network and seeks a data scientist for contract work, operating remotely. The role focuses on designing grading criteria for data science deliverables, evaluating AI-generated and human-created work, and providing transparent, justified evaluations to support model performance improvements.

The ideal candidate will have 1+ years of experience in data science, strong Python and SQL skills, expertise in statistical modeling, ML, and experimentation, and

Qualifications

• 1+ years of professional data science experience.
• Exceptional written communication skills.
• Strong command of Python, SQL, statistical modeling, machine learning and experimentation.

Responsibilities

• Design precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, machine learning pipelines, and A/B test write-ups.
• Evaluate AI-generated or human-created work against established criteria to ensure quality and consistency.
• Provide detailed written justifications for evaluations and scores to maintain transparency and accountability.
• Apply consistent, evidence-based judgment to ensure assessments are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate on submitted work for continuous improvement.
• Work independently and asynchronously to meet deadlines and improve AI model performance.

Skills

1+ years data science experience

Written communication

Python

SQL

Statistical modeling

Machine learning

Experimentation

Job description

Mercor is expanding its data science talent network and seeks a data scientist for contract work, operating remotely. The role focuses on designing grading criteria for data science deliverables, evaluating AI-generated and human-created work, and providing transparent, justified evaluations to support model performance improvements.

The ideal candidate will have 1+ years of experience in data science, strong Python and SQL skills, expertise in statistical modeling, ML, and experimentation, and