DevOps Engineer - AI Trainer

DataAnnotation; New Mexico; Remote; USD 124,000 - 207,000; Full time

Benefits offered by this job

Flexible remote work

Project-based work

Contributors earn substantial earnings

Job summary

DataAnnotation is seeking contributors to run agentic coding sessions on real engineering tasks, analyze model outputs, and red-team the models to expose failures before they reach users. You will document findings and rate the AI's reasoning to guide future improvements.

All work is flexible, remote, and project-based, with emphasis on clear English explanations and demonstrated ability to ship production-quality code. No degree is required.

Qualifications

• Proven experience shipping production code in open-source or similar projects.
• Clear written English explanations as training signals.
• Degree not required; focus on what you can do.

Responsibilities

• Run coding sessions with frontier models on real tasks.
• Analyze AI-generated code against production standards and rate reasoning.
• Red-team models to uncover unsafe code and confidently wrong solutions.

Skills

Open-source experience

English communication

Code debugging

Job description

The newest models can vibe-code a whole feature in minutes. Someone has to check whether that code actually works, and that someone is you.

You'll run agentic coding sessions on real engineering tasks, analyze what the models produce, and red-team them until they fail in interesting ways. Every failure you document teaches the next generation of coding agents.

What you’ll actually do

• Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

What we look for

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Compensation

Up to $150+/hr depending on task difficulty and specialization. Many contributors add $100k–$200k a year; some make it their full-time income.

About DataAnnotation

DataAnnotation is where 1M+ experts train the world’s leading AI models. Hundreds of millions paid to contributors to date, and the average contributor stays 5+ years. Flexible, remote, and always project-available.