Remote AI Coding Auditor & Red-Team Researcher

DataAnnotation; Pennsylvania; Remote; USD 55,000 - 207,000; Full time

Job summary

DataAnnotation is seeking contributors to test and improve AI agents by vibing‑coding on real tasks, analyzing model outputs, and identifying failure modes to guide future improvements. You’ll document results, assess reasoning quality, and help push boundaries of automated coding while maintaining production standards.

The role emphasizes clear English explanations, practical code experience, and the ability to work remotely without a formal degree requirement.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Responsibilities

• Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Skills

Open-source experience

Clear written English

Job description

DataAnnotation is seeking contributors to test and improve AI agents by vibing‑coding on real tasks, analyzing model outputs, and identifying failure modes to guide future improvements. You’ll document results, assess reasoning quality, and help push boundaries of automated coding while maintaining production standards.

The role emphasizes clear English explanations, practical code experience, and the ability to work remotely without a formal degree requirement.