Flexible Remote AI Coding QA & Red-Teaming Engineer

DataAnnotation; Town of Vermont (WI); Remote; USD 55,000 - 207,000; Full time

Job summary

DataAnnotation is where 100k+ experts train the world’s leading AI models. The role involves running agentic coding sessions on real engineering tasks, analyzing model outputs, and red-teaming them until they fail in interesting ways.

You’ll document failures to teach the next generation of coding agents. Flexibility is emphasized: remote, project-based work with compensation up to $40–$150+ per hour, depending on task difficulty and specialization.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Responsibilities

• Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Skills

Open-source experience

Production code shipping

Clear written English

Job description

DataAnnotation is where 100k+ experts train the world’s leading AI models. The role involves running agentic coding sessions on real engineering tasks, analyzing model outputs, and red-teaming them until they fail in interesting ways.

You’ll document failures to teach the next generation of coding agents. Flexibility is emphasized: remote, project-based work with compensation up to $40–$150+ per hour, depending on task difficulty and specialization.