Remote Mobile App QA & Policy Reviewer

AI Trainer Jobs; United States; Remote; USD 97,000 - 138,000; Part time

Job summary

AI Trainer Jobs invites a Remote Mobile App Evaluation Specialist to join as an independent contractor. You will review AI outputs for mobile app evaluation workflows, grade workflow correctness and policy adherence, and document the right next step to help our modeling team train more effectively.

Ideal candidates bring experience evaluating outputs on real teams, apply structured rubrics consistently, and communicate written reasoning clearly.

Qualifications

• Experience in mobile app evaluation operations on real teams.
• Ability to apply multi-page rubrics consistently to outputs.
• Clear written reasoning naming the policy or workflow applied.
• Strong attention to detail with async availability

Responsibilities

• Review AI outputs against current mobile app evaluation workflows, playbooks, and policy.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Mobile App Evaluation operations

Code review

Software testing

Agent evaluation

Mobile

Job description

AI Trainer Jobs invites a Remote Mobile App Evaluation Specialist to join as an independent contractor. You will review AI outputs for mobile app evaluation workflows, grade workflow correctness and policy adherence, and document the right next step to help our modeling team train more effectively.

Ideal candidates bring experience evaluating outputs on real teams, apply structured rubrics consistently, and communicate written reasoning clearly.