Remote DevOps Engineer — AI Model Validation & Red-Teaming

DataAnnotation; Oregon; Remote; USD 124,000 - 207,000; Full time

Job summary

DataAnnotation is building the next generation of coding agents and seeking contributors who can vibe-code with frontier models on real tasks. You’ll fix bugs, extend APIs, and ship features while evaluating how far the model can operate independently.

You’ll analyze the AI’s output against production standards, document failures clearly, and rate the model’s reasoning. This role emphasizes practical impact over formal degrees and welcomes remote, project-based work.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: explanations are the training signal.
• No degree required.

Responsibilities

• Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Skills

Open-source experience

Clear written English

No degree required

Job description

DataAnnotation is building the next generation of coding agents and seeking contributors who can vibe-code with frontier models on real tasks. You’ll fix bugs, extend APIs, and ship features while evaluating how far the model can operate independently.

You’ll analyze the AI’s output against production standards, document failures clearly, and rate the model’s reasoning. This role emphasizes practical impact over formal degrees and welcomes remote, project-based work.