Remote AI Debugger & Red-Teamer for Frontier Models

DataAnnotation; Wisconsin; Remote; USD 55,000 - 207,000; Full time

Job summary

DataAnnotation is where 100k+ experts train the world’s leading AI models. $150M+ paid to contributors to date, and the average contributor stays 5+ years. Flexible, remote, project-available.

Every failure you document teaches the next generation of coding agents. The newest models can vibe-code a whole feature in minutes. You’ll run agentic coding sessions on real engineering tasks, analyze the models’ output, and red-team them until they fail in interesting ways.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Responsibilities

• Vibe-code with frontier models on real tasks to fix bugs and ship features.
• Analyze the AI's work against production standards and rate the model's reasoning.
• Red-team models to expose unsafe code and confidently wrong solutions before real users hit them.

Skills

Open-source experience

Clear written English

Job description

DataAnnotation is where 100k+ experts train the world’s leading AI models. $150M+ paid to contributors to date, and the average contributor stays 5+ years. Flexible, remote, project-available.

Every failure you document teaches the next generation of coding agents. The newest models can vibe-code a whole feature in minutes. You’ll run agentic coding sessions on real engineering tasks, analyze the models’ output, and red-team them until they fail in interesting ways.