Remote Part-Time Data Scientist — Create & Score AI Tasks

OpenTrain AI

United States

Remote

USD 83,000 - 165,000

Part time

48 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Fully remote
Flexible schedule
Independent contractor

Job summary

OpenTrain AI is seeking experienced data scientists to craft and evaluate challenging tasks for coding agents. You’ll design data science problems, assemble data and environments, and write reference solutions with tests and scoring rules.

Work remotely on your own schedule, paid per accepted task. You’ll prepare datasets, dependencies, and run requirements; verify reference implementations; set up evaluation tests; and guide coding agents through debugging and verification steps.

Qualifications

  • Fluent in English.
  • Strong Python skills for testing and debugging unfamiliar code.
  • Background in data science, machine learning, quantitative modeling, or research competitions.

Responsibilities

  • Prepare the execution setup, including the required data, dependencies, and run requirements.
  • Write and verify reference implementations for each data science task.
  • Set up tests and scoring rules to distinguish complete, correct work from partial or flawed approaches.
  • Have coding agents attempt the tasks, trace failures, and record the checks used.

Skills

Python
Testing & debugging
Data science background
English fluency

Tools

CodaLab
Codabench
Kaggle
Numerai
Zindi
AIcrowd
DataSource.ai
DrivenData

Job description

OpenTrain AI is seeking experienced data scientists to craft and evaluate challenging tasks for coding agents. You’ll design data science problems, assemble data and environments, and write reference solutions with tests and scoring rules.

Work remotely on your own schedule, paid per accepted task. You’ll prepare datasets, dependencies, and run requirements; verify reference implementations; set up evaluation tests; and guide coding agents through debugging and verification steps.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Scientist, Part-Time ML Task Authoring - Remote (United States)
Data Scientist, Part-Time ML Task Authoring - Remote (United States)

OpenTrain AI • United States

Remote
USD 83,000 - 165,000
Fully remote
Flexible schedule
Independent contractor
Remote Part-Time Backend Engineer — AI Task Design
Remote Part-Time Backend Engineer — AI Task Design

OpenTrain AI • United States

Remote
USD 41,000 - 138,000
Remote Part-Time Full-Stack Engineer for AI Code Evaluation
Remote Part-Time Full-Stack Engineer for AI Code Evaluation

OpenTrain AI • United States

Remote
USD 69,000 - 138,000
Part-Time Full-Stack Engineer for AI Task Evaluation Remote
Part-Time Full-Stack Engineer for AI Task Evaluation Remote

pofft Technology Inc. • United States

Remote
USD 69,000 - 138,000
Fully remote
Data Science AI Response Evaluator - Remote, Part-Time
Data Science AI Response Evaluator - Remote, Part-Time

OpenTrain AI, Inc. • United States

Remote
USD 136,000 - 194,000
Remote Data Scientist - AI Evaluation & Feedback
Remote Data Scientist - AI Evaluation & Feedback

Handshake • United States

Remote
USD 152,000 - 179,000
Remote Part-Time Backend Engineer for AI Task Design
Remote Part-Time Backend Engineer for AI Task Design

OpenTrain AI • United States

Remote
USD 41,000 - 138,000
Fully remote
Flexible schedule
Remote Part-Time Full-Stack Engineer for AI Task Review
Remote Part-Time Full-Stack Engineer for AI Task Review

Ali Aydi • United States

Remote
USD 69,000 - 138,000
Remote Part-Time Backend Engineer for AI Task Design
Remote Part-Time Backend Engineer for AI Task Design

Devconnectplatform • United States

Remote
USD 41,000 - 138,000
Remote work
Flexible schedule
Remote AI Trainer & Data Science Evaluator
Remote AI Trainer & Data Science Evaluator

Accountingfly • Oregon

Remote
USD 55,000 - 172,000
Competitive hourly pay (USD)
Fully remote with flexible scheduling
Multi-day task timers and scalable hrs
+3