Remote AI Coding Auditor & Red-Team Researcher

DataAnnotation

Pennsylvania

Remote

USD 55,000 - 207,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

DataAnnotation is seeking contributors to test and improve AI agents by vibing‑coding on real tasks, analyzing model outputs, and identifying failure modes to guide future improvements. You’ll document results, assess reasoning quality, and help push boundaries of automated coding while maintaining production standards.

The role emphasizes clear English explanations, practical code experience, and the ability to work remotely without a formal degree requirement.

Qualifications

  • Professional or serious open-source experience shipping production code.
  • Clear written English: your explanations are the training signal.
  • No degree required. We care about what you can do, not where you learned it.

Responsibilities

  • Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
  • Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
  • Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Skills

Open-source experience
Clear written English

Job description

DataAnnotation is seeking contributors to test and improve AI agents by vibing‑coding on real tasks, analyzing model outputs, and identifying failure modes to guide future improvements. You’ll document results, assess reasoning quality, and help push boundaries of automated coding while maintaining production standards.

The role emphasizes clear English explanations, practical code experience, and the ability to work remotely without a formal degree requirement.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Code Auditor & Red-Team Engineer
Remote AI Code Auditor & Red-Team Engineer

DataAnnotation • Wisconsin

Remote
USD 124,000 - 207,000
Remote AI Code Auditor & Red-Team Engineer
Remote AI Code Auditor & Red-Team Engineer

DataAnnotation • New Mexico

Remote
USD 55,000 - 207,000
Remote AI Code Auditor & Red-Teaming Engineer
Remote AI Code Auditor & Red-Teaming Engineer

DataAnnotation • Washington

Remote
USD 100,000 - 200,000
Flexible work arrangement
Remote work
Remote AI Code Validator & Red-Team Engineer
Remote AI Code Validator & Red-Team Engineer

DataAnnotation • Massachusetts

Remote
USD 138,000 - 207,000
AI Code Auditor & Red-Teamer — Remote, Flexible
AI Code Auditor & Red-Teamer — Remote, Flexible

DataAnnotation • Rhode Island

Remote
USD 170,000 - 243,000
Remote work
Remote AI Code Auditor & Red-Teaming Scientist
Remote AI Code Auditor & Red-Teaming Scientist

DataAnnotation • Kentucky

Remote
USD 55,000 - 207,000
Flexible schedule
Remote work
Project-based work
Remote AI Code Auditor & Red-Teamer
Remote AI Code Auditor & Red-Teamer

DataAnnotation • McLean (VA)

Remote
USD 170,000 - 243,000
Remote AI Validation Engineer: Vibe-Code & Red Team
Remote AI Validation Engineer: Vibe-Code & Red Team

DataAnnotation • New Jersey

Remote
USD 55,000 - 207,000
Flexible schedule
Remote work
Remote AI Code Auditor & Red-Team Engineer
Remote AI Code Auditor & Red-Team Engineer

DataAnnotation • Winston-Salem (NC)

Remote
USD 124,000 - 207,000
Flexible
Remote work
Project-based
AI Coding Auditor & Red-Team Scientist (Remote)
AI Coding Auditor & Red-Team Scientist (Remote)

DataAnnotation • Pennsylvania

Remote
USD 55,000 - 207,000
Flexible work arrangements
Remote work
Project-based opportunities