AI Model QA Engineer (Remote, Flexible)

DataAnnotation; Massachusetts; Remote; USD 138,000 - 207,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Job summary

DataAnnotation is seeking contributors who can test and improve the company’s AI tooling. You’ll run vibe-code sessions, analyze model outputs, and push back with documented failures to strengthen future agents.

Flexibility is key: remote work is welcome, no degree is required, and compensation can reach $150+ per hour depending on task difficulty and specialization. You will document failures, rate reasoning, and help the next generation of coding agents.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Responsibilities

• Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Skills

Open-source experience

Shipping production code

Clear written English

Job description

DataAnnotation is seeking contributors who can test and improve the company’s AI tooling. You’ll run vibe-code sessions, analyze model outputs, and push back with documented failures to strengthen future agents.

Flexibility is key: remote work is welcome, no degree is required, and compensation can reach $150+ per hour depending on task difficulty and specialization. You will document failures, rate reasoning, and help the next generation of coding agents.