AI Model QA & Red Team Engineer (Remote)

DataAnnotation; West Virginia; Remote; USD 170,000 - 243,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Project-based work

Job summary

DataAnnotation is seeking contributors who can run agentic coding sessions, analyze AI-generated code, and systematically test and rate model reasoning. You will help push the boundaries of coding agents by identifying failures and documenting them for the next generation.

The role emphasizes clear written explanations and practical production experience, with flexible, remote work and a focus on task-based impact rather than formal degrees.

Qualifications

• Open-source experience shipping production code.
• Clear written English: explanations are the training signal.
• No degree required.

Responsibilities

• Run agentic coding sessions on real tasks and fix or extend APIs.
• Analyze model outputs against production standards and rate reasoning.
• Red-team models to expose unsafe code and confidently wrong solutions before users see them.

Skills

Open-source experience

Strong written English

Job description

DataAnnotation is seeking contributors who can run agentic coding sessions, analyze AI-generated code, and systematically test and rate model reasoning. You will help push the boundaries of coding agents by identifying failures and documenting them for the next generation.

The role emphasizes clear written explanations and practical production experience, with flexible, remote work and a focus on task-based impact rather than formal degrees.