Remote AI Code Auditor & Red-Teaming Engineer

DataAnnotation; Washington; Remote; USD 100,000 - 200,000; Full time

Benefits offered by this job

Flexible work arrangement

Remote work

Job summary

DataAnnotation is seeking a sharp, self-directed contributor to test and critique cutting-edge coding models. You will run agentic coding sessions, analyze model outputs, and document failures to improve future generations of coding agents.

You’ll systematically identify bugs, explain failures, and rate reasoning against production standards, while helping push the boundaries of what frontier AI can safely accomplish.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Responsibilities

• Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Job description

DataAnnotation is seeking a sharp, self-directed contributor to test and critique cutting-edge coding models. You will run agentic coding sessions, analyze model outputs, and document failures to improve future generations of coding agents.

You’ll systematically identify bugs, explain failures, and rate reasoning against production standards, while helping push the boundaries of what frontier AI can safely accomplish.