Remote Application Security AI QA Specialist

AI Trainer Jobs; United States; Remote; USD 41,000 - 83,000; Part time

Benefits offered by this job

Remote work

Job summary

AI Trainer Jobs is seeking an Application Security AI Specialist contractor to review AI outputs against workflows, playbooks, and firm policy. You will grade tone, escalation logic, and stakeholder fit on a structured rubric, flag gaps, and capture next steps to train the model.

This remote, contractor role offers hourly compensation after interview and requires about 10 hours of work per week, with placement based on program demand.

Qualifications

• Direct working experience in application security AI operations on real teams.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning naming the policy or workflow applied.
• Strong attention to detail and ability to flag prompt issues.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against workflows, playbooks, and firm policy for Application Security AI Specialist assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.

Skills

Direct experience in App Security AI

Written reasoning documentation

Attention to detail

Async availability 10h/wk

Tools

AI-assisted workflow tooling

Job description

AI Trainer Jobs is seeking an Application Security AI Specialist contractor to review AI outputs against workflows, playbooks, and firm policy. You will grade tone, escalation logic, and stakeholder fit on a structured rubric, flag gaps, and capture next steps to train the model.

This remote, contractor role offers hourly compensation after interview and requires about 10 hours of work per week, with placement based on program demand.