AI Model Auditor & Red-Teamer (Remote)

DataAnnotation; Town of Texas (WI); Remote; USD 55,000 - 207,000; Full time

Job summary

DataAnnotation is seeking contributors to vibe-code with frontier models on real engineering tasks, such as fixing bugs, extending APIs, and shipping features. You will analyze the AI’s work against production standards, identify bugs, explain failures, and rate the model’s reasoning.

You’ll also red-team to reveal unsafe code, fake test passes, and confidently wrong solutions before real users are affected.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Responsibilities

• Run agentic coding sessions on real engineering tasks, analyze the models' output, and red-team them until they fail in interesting ways.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Skills

Open-source experience

Production code

Clear written English

Job description

DataAnnotation is seeking contributors to vibe-code with frontier models on real engineering tasks, such as fixing bugs, extending APIs, and shipping features. You will analyze the AI’s work against production standards, identify bugs, explain failures, and rate the model’s reasoning.

You’ll also red-team to reveal unsafe code, fake test passes, and confidently wrong solutions before real users are affected.