AI Model QA Engineer — Remote, Flexible Projects

DataAnnotation; Phoenix (AZ); Remote; USD 124,000 - 207,000; Full time

Benefits offered by this job

Flexible, remote work

Project-based opportunities

Job summary

DataAnnotation is seeking contributors to vibe-code with frontier models on real tasks, fix bugs, extend APIs, and ship features while evaluating how far the model progresses. You will analyze the AI's outputs against production standards and rate the model's reasoning, then red-team to expose unsafe code and confidently wrong solutions before real users encounter them.

Strong written English and production-code shipping experience are valued; no degree is required.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Responsibilities

• Vibe-code with frontier models on real tasks: fix bugs, extend APIs, ship features.
• Analyze the AI's work against production standards: find bugs, explain failures, and rate the model's reasoning.
• Red-team the models to expose unsafe code, failed tests, and confidently wrong solutions before real users.

Skills

Open-source experience

English proficiency

No degree required

Job description

DataAnnotation is seeking contributors to vibe-code with frontier models on real tasks, fix bugs, extend APIs, and ship features while evaluating how far the model progresses. You will analyze the AI's outputs against production standards and rate the model's reasoning, then red-team to expose unsafe code and confidently wrong solutions before real users encounter them.

Strong written English and production-code shipping experience are valued; no degree is required.