AI Model Evaluator & Red-Teaming Scientist (Remote)

DataAnnotation

Wisconsin

Remote

USD 55,000 - 207,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible schedule
Remote work

Job summary

DataAnnotation is where 100k+ experts train the world’s leading AI models. The newest models can vibe-code a whole feature in minutes, but someone has to check whether that code actually works, and that someone is you.

You’ll run agentic coding sessions on real engineering tasks, analyze what the models produce, and red-team them until they fail in interesting ways. Compensation is up to $40–$150+/hr, with additional earnings potential.

Qualifications

  • Professional or serious open-source experience shipping production code.
  • Clear written English: your explanations are the training signal.
  • No degree required. We care about what you can do, not where you learned it.

Responsibilities

  • Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
  • Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
  • Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Skills

Open-source experience
Clear written English

Education

No degree required

Job description

DataAnnotation is where 100k+ experts train the world’s leading AI models. The newest models can vibe-code a whole feature in minutes, but someone has to check whether that code actually works, and that someone is you.

You’ll run agentic coding sessions on real engineering tasks, analyze what the models produce, and red-team them until they fail in interesting ways. Compensation is up to $40–$150+/hr, with additional earnings potential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Code Auditor & Red-Teamer
Remote AI Code Auditor & Red-Teamer

DataAnnotation • Oklahoma

Remote
USD 138,000 - 207,000
AI Code Auditor & Red-Teaming Specialist — Remote
AI Code Auditor & Red-Teaming Specialist — Remote

DataAnnotation • Tennessee

Remote
USD 55,000 - 207,000
Flexible remote work
Project-based work
Remote AI Model QA Engineer & Red-Teaming
Remote AI Model QA Engineer & Red-Teaming

DataAnnotation • Louisiana

Remote
USD 170,000 - 243,000
Flexible schedule
Remote work
Project-based work
Remote AI Code Critic & Red-Teamer (Full-Stack)
Remote AI Code Critic & Red-Teamer (Full-Stack)

DataAnnotation • Chandler (AZ)

Remote
USD 124,000 - 207,000
Flexible remote work
Project-based work
AI Coding Validator & Red-Team Engineer
AI Coding Validator & Red-Team Engineer

DataAnnotation • Rhode Island

Remote
USD 55,000 - 207,000
Imaging AI Validator & Red‑Team Engineer
Imaging AI Validator & Red‑Team Engineer

DataAnnotation • Wyoming (OH)

Remote
USD 55,000 - 207,000
AI Model Auditor & Red-Teamer (Remote)
AI Model Auditor & Red-Teamer (Remote)

DataAnnotation • Texas

Remote
USD 55,000 - 207,000
AI Model Testing Engineer - Remote, Flexible, High Pay
AI Model Testing Engineer - Remote, Flexible, High Pay

DataAnnotation • Mississippi

Remote
USD 124,000 - 207,000
Flexible, remote work
AI Model QA Engineer — Remote, Flexible Projects
AI Model QA Engineer — Remote, Flexible Projects

DataAnnotation • South Dakota

Remote
USD 170,000 - 243,000
Flexible
Remote work
Project-based work
Remote AI Debugger & Red-Teamer for Frontier Models
Remote AI Debugger & Red-Teamer for Frontier Models

DataAnnotation • Wisconsin

Remote
USD 55,000 - 207,000