AI QA Engineer: Remote Frontline Model Testing & Red-Teaming

DataAnnotation; Rhode Island; Remote; USD 100,000 - 200,000; Full time

Benefits offered by this job

Remote work

Project-based pay

Competitive hourly rate

Job summary

DataAnnotation is seeking contributors to run agentic coding sessions on real tasks, analyze what the models produce, and red-team them until they fail in interesting ways. You’ll document failures to teach the next generation of coding agents, and help improve production code standards.

You’ll fix bugs, extend APIs, and ship features, while communicating clearly in English. This is a flexible, remote, project-based opportunity designed for experienced developers who value practical impact.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Responsibilities

• Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Skills

Open-source shipping

Clear written English

Education

No degree required

Job description

DataAnnotation is seeking contributors to run agentic coding sessions on real tasks, analyze what the models produce, and red-team them until they fail in interesting ways. You’ll document failures to teach the next generation of coding agents, and help improve production code standards.

You’ll fix bugs, extend APIs, and ship features, while communicating clearly in English. This is a flexible, remote, project-based opportunity designed for experienced developers who value practical impact.