Remote AI Model QA & Red-Teaming Engineer

DataAnnotation; Pennsylvania; Remote; USD 55,000 - 207,000; Full time

Benefits offered by this job

Flexible work

Remote work

Project-based

Job summary

DataAnnotation is seeking contributors to vibe-code with frontier models on real engineering tasks, analyze the AI outputs, and document failures to improve future coding agents. You will fix bugs, extend APIs, and ship features while evaluating against production standards.

Applicants should have professional or open-source experience shipping production code, and clear written English. No degree is required; remote, flexible, and project-based work is offered.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required.

Responsibilities

• Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Skills

Open-source experience

Clear written English

No degree required

Job description

DataAnnotation is seeking contributors to vibe-code with frontier models on real engineering tasks, analyze the AI outputs, and document failures to improve future coding agents. You will fix bugs, extend APIs, and ship features while evaluating against production standards.

Applicants should have professional or open-source experience shipping production code, and clear written English. No degree is required; remote, flexible, and project-based work is offered.