AI Code QA Engineer — Remote, Flexible

DataAnnotation; Maine; Remote; USD 170,000 - 243,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Project-based earnings

Job summary

DataAnnotation is seeking contributors to test and critique the latest AI coding models. You’ll run agentic coding sessions on real engineering tasks, analyze outputs, and document failures to guide future improvements.

We value open-source experience and clear written English. No degree is required; what you can do matters more than where you learned it. This is a flexible, remote role with project-based availability.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Responsibilities

• Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Skills

Open-source experience

Clear written English

No degree required

Job description

DataAnnotation is seeking contributors to test and critique the latest AI coding models. You’ll run agentic coding sessions on real engineering tasks, analyze outputs, and document failures to guide future improvements.

We value open-source experience and clear written English. No degree is required; what you can do matters more than where you learned it. This is a flexible, remote role with project-based availability.