AI Model Evaluator / AI Trainer

Draft labs; Miami (FL); Remote; USD 28,000 - 276,000; Part time

Job summary

Draft labs is seeking remote AI Model Evaluators and AI Trainers in the United States. This role involves reviewing AI outputs, ranking responses, and providing detailed feedback to improve model performance.

No prior professional experience is required, and the position is a part-time contractor with flexible hours. Ideal candidates are current students or recent graduates who can follow detailed instructions, communicate clearly in writing, and show strong attention to detail.

Qualifications

• Must be based in the United States.
• Must complete a short benchmark before receiving paid tasks.
• Must be able to follow detailed instructions without relying on AI.
• Must have reliable internet access and a laptop or desktop computer.

Responsibilities

• Compare AI-generated responses and select the stronger answer.
• Write clear explanations for why one response is better.
• Complete computer-use tasks in browser-based environments.
• Evaluate AI outputs for accuracy, reasoning, clarity, tone, and instruction following.
• Follow detailed project-specific rubrics and guidelines.
• Complete benchmark tasks before unlocking paid projects.
• Maintain high-quality work across assigned tasks.

Skills

Attention to detail

Written communication

Instruction following

Interest in AI

Education

Computer Science or related field

Data Science or related field

Job description

Job Description

We are hiring remote AI Model Evaluators and AI Trainers to support multiple ongoing AI training projects.

We are building an in-house contributor team for work across AI model evaluations, computer-use tasks, response ranking, red teaming, tool-use evaluation, and other AI training workflows.

In this role, you may review AI-generated responses, compare outputs, test whether an AI followed instructions, complete browser-based computer-use tasks, or provide feedback that helps improve model performance.

This is flexible remote work for detail-oriented students, recent graduates, and early-career professionals who can follow instructions carefully and produce high-quality work.

Responsibilities

• Compare AI-generated responses and select the stronger answer


• Write clear explanations for why one response is better


• Complete computer-use tasks in browser-based environments


• Evaluate AI outputs for accuracy, reasoning, clarity, tone, and instruction following


• Follow detailed project-specific rubrics and guidelines


• Complete benchmark tasks before unlocking paid projects


• Maintain high-quality work across assigned tasks

Ideal candidates

• Current undergraduate student, graduate student, recent graduate, or early-career professional


• Strong attention to detail


• Clear written communication


• Comfortable following detailed instructions


• Interest in AI, model evaluation, computer-use agents, language, reasoning, or technology


• Strong fit for students in Computer Science, Data Science, Business, Economics, Finance, English, Linguistics, Philosophy, or related fields

Compensation

$20-$200/hour depending on project type, difficulty, and required expertise

Flexible remote work

Paid work becomes available after completing project benchmarks

Requirements

• Must be based in the United States


• Must complete a short benchmark before receiving paid tasks


• Must be able to follow detailed instructions without relying on AI to complete the work


• Must have reliable internet access and a laptop or desktop computer

Type of position

Part-time contractor / remote

Work experience

No prior professional experience required

Current students and recent graduates welcome