Remote AI Coding Auditor for Public Health

DataAnnotation; Washington; Remote; USD 55,000 - 207,000; Full time

Benefits offered by this job

Flexible work options

Remote work

Open-source friendly

Job summary

DataAnnotation is seeking contributors to run agentic coding sessions on real engineering tasks. You’ll analyze model outputs, document failures, and help improve future coding agents by red-teaming them before real users encounter issues.

You should have professional or serious open-source experience shipping production code and be able to explain your work in clear English. No degree is required, and flexible remote work is available.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Responsibilities

• Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
• Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
• Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Skills

Production-grade coding

Clear written English

No degree required

Job description

DataAnnotation is seeking contributors to run agentic coding sessions on real engineering tasks. You’ll analyze model outputs, document failures, and help improve future coding agents by red-teaming them before real users encounter issues.

You should have professional or serious open-source experience shipping production code and be able to explain your work in clear English. No degree is required, and flexible remote work is available.