Remote AI Coding QA Analyst & Red-Teamer

DataAnnotation; New Mexico; Remote; USD 55,000 - 207,000; Full time

Job summary

DataAnnotation is seeking a contributor to run agentic coding sessions on real engineering tasks, analyze what the models produce, and red-team them until they fail in interesting ways.

You’ll vibe-code with frontier models to fix bugs, extend APIs, ship features, and see how far the model gets on its own, then assess the AI's reasoning against production standards. This is a remote, contract-style role with flexible hours.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Responsibilities

• Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Skills

Shipping production code

Clear written English

Job description

DataAnnotation is seeking a contributor to run agentic coding sessions on real engineering tasks, analyze what the models produce, and red-team them until they fail in interesting ways.

You’ll vibe-code with frontier models to fix bugs, extend APIs, ship features, and see how far the model gets on its own, then assess the AI's reasoning against production standards. This is a remote, contract-style role with flexible hours.