Remote AI Validation Engineer & Red-Team Analyst

DataAnnotation; Rhode Island; Remote; USD 55,000 - 207,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Job summary

DataAnnotation is a remote-friendly platform where 100k+ experts help train AI models. You will vibe-code with frontier models on real tasks, analyze the model’s work against production standards, and red-team the models to uncover unsafe code and weaknesses before real users see them.

The role emphasizes clear written English and the ability to explain failures as part of the training signal. No degree is required, and compensation is task-based with flexible, remote work options.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.

Responsibilities

• Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Skills

Open-source experience

Clear written English

Job description

DataAnnotation is a remote-friendly platform where 100k+ experts help train AI models. You will vibe-code with frontier models on real tasks, analyze the model’s work against production standards, and red-team the models to uncover unsafe code and weaknesses before real users see them.

The role emphasizes clear written English and the ability to explain failures as part of the training signal. No degree is required, and compensation is task-based with flexible, remote work options.