Remote AI QA Engineer & Red-Teaming

DataAnnotation; Texas; Remote; USD 165,000 - 248,000; Full time

Job summary

DataAnnotation is seeking a contributor to run agentic coding sessions on real engineering tasks, analyze model outputs, and red-team them to expose failures before real users. You’ll document findings and help improve future coding agents.

Applicants should have professional or serious open-source experience shipping production code and clear written English. No degree required; what you can do matters more than where you learned it. Remote, flexible, project-based work.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Responsibilities

• Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Skills

Open-source shipping

Code analysis

Clear writing

Education

No degree required

Job description

DataAnnotation is seeking a contributor to run agentic coding sessions on real engineering tasks, analyze model outputs, and red-team them to expose failures before real users. You’ll document findings and help improve future coding agents.

Applicants should have professional or serious open-source experience shipping production code and clear written English. No degree required; what you can do matters more than where you learned it. Remote, flexible, project-based work.