AI Vibe-Code Auditor & Red-Teaming Specialist

DataAnnotation; Texas; Remote; USD 55,000 - 207,000; Full time

Benefits offered by this job

Flexible remote work

Job summary

DataAnnotation seeks contributors to vet and improve AI models by running agentic coding tasks, evaluating the results, and documenting failures to guide future models.

You will validate model outputs, explain issues clearly, and help rate the quality of reasoning while working remotely on diverse coding tasks.

Qualifications

• Open-source experience shipping production code.
• Clear written English for explanations and documentation.
• No degree required; relevant skills matter most.

Responsibilities

• Vibe-code with frontier models on real tasks: fix bugs, extend APIs, ship features, and test model autonomy.
• Analyze the AI's work against production standards: identify bugs, explain failures, and rate reasoning.
• Red-team models to uncover unsafe code, fake test passes, and confidently wrong solutions before users encounter them.

Skills

Open-source experience

Strong written English

Job description

The newest models can vibe-code a whole feature in minutes. Someone has to check whether that code actually works, and that someone is you.

You'll run agentic coding sessions on real engineering tasks, analyze what the models produce, and red-team them until they fail in interesting ways. Every failure you document teaches the next generation of coding agents.

What you’ll actually do

• Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Roles this fits

What we look for

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

How it works

Apply

Qualify

Work & get paid

Compensation

Up to $150+/hr depending on task difficulty and specialization. Many contributors add $100k–$200k a year; some make it their full-time income.

About DataAnnotation

DataAnnotation is where 100k+ experts train the world’s leading AI models. $150M+ paid to contributors to date, and the average contributor stays 5+ years. Flexible, remote, and always project-available.