Remote QA Evaluator: Windows Premiere Apps

Auraone

United States

Remote

USD 41,000 - 55,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote work
Contractor role
Competitive pay
Flexible tasks

Job summary

AI Trainer Jobs is seeking a remote contractor to evaluate application users premiere on Windows generalist evaluation outputs. You will apply a versioned rubric, label issues, and provide structured feedback for retraining efforts.

Responsibilities include comparing responses, selecting the stronger answer with justification, tagging policy violations, and documenting ambiguous prompts for rubric updates. This is a remote, part-time contractor position in the United States with hourly

Qualifications

  • Prior evaluation, annotation, or human-rater experience in AI content review.
  • Comfort applying rubrics across long batches.
  • Clear written reasoning naming the issue and rubric clause.
  • Strong attention to detail and ability to flag prompt problems.

Responsibilities

  • Evaluate model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and select the stronger one with a rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with tags.
  • Capture ambiguous prompts and report feedback for rubric updates.

Skills

Evaluation experience
Written reasoning
Attention to detail
Flag prompts issues
Async availability

Education

Linguistics background

Job description

AI Trainer Jobs is seeking a remote contractor to evaluate application users premiere on Windows generalist evaluation outputs. You will apply a versioned rubric, label issues, and provide structured feedback for retraining efforts.

Responsibilities include comparing responses, selecting the stronger answer with justification, tagging policy violations, and documenting ambiguous prompts for rubric updates. This is a remote, part-time contractor position in the United States with hourly

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Application Users - Premiere on Windows - Generalist
Application Users - Premiere on Windows - Generalist

Auraone • United States

Remote
USD 41,000 - 55,000
Remote work
Contractor role
Competitive pay
+1
Remote Video Data Reviewer: AI Quality & Feedback
Remote Video Data Reviewer: AI Quality & Feedback

Auraone • United States

Remote
USD 17,000 - 28,000
Remote Video Content Evaluator & Rubric Specialist
Remote Video Content Evaluator & Rubric Specialist

Auraone • United States

Remote
USD 21,000 - 34,000
Remote Windows Premiere Editor — Contract, AI Feedback
Remote Windows Premiere Editor — Contract, AI Feedback

Mercor • San Francisco (CA)

Hybrid
GBP 31,000 - 42,000
Remote Adobe Photoshop QA & Operations Reviewer
Remote Adobe Photoshop QA & Operations Reviewer

Auraone • United States

Remote
USD 34,000 - 55,000
Remote AI Data Evaluator: Video Review & Rubric Feedback
Remote AI Data Evaluator: Video Review & Rubric Feedback

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Remote Document QA Evaluator - Rubric-Based Review
Remote Document QA Evaluator - Rubric-Based Review

Auraone • United States

Remote
USD 110,000 - 165,000
Video QA Reviewer: AI Edits & Post-Production Quality
Video QA Reviewer: AI Edits & Post-Production Quality

Claru • United States

Remote
USD 48,000 - 76,000
Remote AI Data Reviewer — Content Evaluation (Contract)
Remote AI Data Reviewer — Content Evaluation (Contract)

AuraOne Human Data • United States

Remote
USD 41,000 - 55,000
Remote AI Model Output Evaluator - Photoshop on Windows
Remote AI Model Output Evaluator - Photoshop on Windows

Auraone • United States

Remote
USD 41,000 - 55,000