AI Model Testing Engineer - Remote, Flexible, High Pay

DataAnnotation; Mississippi; Remote; USD 124,000 - 207,000; Full time

Benefits offered by this job

Flexible, remote work

Job summary

DataAnnotation is hiring for a role focused on evaluating and strengthening AI code produced by frontier models. You will run agentic coding sessions on real engineering tasks, analyze model outputs, and document failures to guide future improvements.

We seek professionals with production-code experience and strong written English; no degree is required. Flexible, remote work is available, with compensation up to 150+ USD per hour depending on task difficulty and specialization.

Qualifications

• Professional or serious open-source experience shipping production code.
• Clear written English: your explanations are the training signal.
• No degree required; we care about what you can do, not where you learned it.

Responsibilities

• What you’ll actually do: vibe-code with frontier models on real tasks, fix bugs, extend APIs, ship features and evaluate model progress.
• Analyze the AI’s work against production standards, identify bugs, explain failures, and rate the model's reasoning.
• Red-team the models to expose unsafe code, fake test passes, and confidently wrong solutions before real users hit them.

Skills

Education

Job description

DataAnnotation is hiring for a role focused on evaluating and strengthening AI code produced by frontier models. You will run agentic coding sessions on real engineering tasks, analyze model outputs, and document failures to guide future improvements.

We seek professionals with production-code experience and strong written English; no degree is required. Flexible, remote work is available, with compensation up to 150+ USD per hour depending on task difficulty and specialization.