AI Model QA Engineer - Remote & Flexible

DataAnnotation; New Mexico; Remote; USD 124,000 - 207,000; Full time

Benefits offered by this job

Flexible remote work

Project-based work

Contributors earn substantial earnings

Job summary

DataAnnotation is seeking contributors to run agentic coding sessions on real engineering tasks, analyze model outputs, and red-team the models to expose failures before they reach users. You will document findings and rate the AI's reasoning to guide future improvements.

All work is flexible, remote, and project-based, with emphasis on clear English explanations and demonstrated ability to ship production-quality code. No degree is required.

Qualifications

• Proven experience shipping production code in open-source or similar projects.
• Clear written English explanations as training signals.
• Degree not required; focus on what you can do.

Responsibilities

• Run coding sessions with frontier models on real tasks.
• Analyze AI-generated code against production standards and rate reasoning.
• Red-team models to uncover unsafe code and confidently wrong solutions.

Skills

Open-source experience

English communication

Code debugging

Job description

DataAnnotation is seeking contributors to run agentic coding sessions on real engineering tasks, analyze model outputs, and red-team the models to expose failures before they reach users. You will document findings and rate the AI's reasoning to guide future improvements.

All work is flexible, remote, and project-based, with emphasis on clear English explanations and demonstrated ability to ship production-quality code. No degree is required.