Remote Cloud Infra Evaluation & QA Specialist

AuraOne, Inc.; United States; Remote; USD 25,000 - 50,000; Part time

Job summary

AuraOne, Inc. is seeking a Cloud Infrastructure Workflow Reviewer to evaluate cloud infrastructure workflow model outputs. You will assign severity tags and provide written rationales for comparisons between responses.

This remote role requires prior evaluation or annotation experience, attention to detail, and reliable availability for at least 10 hours weekly. Successful candidates will help ensure high-quality outputs for AI data.

Qualifications

• Prior evaluation, annotation, or human-rater experience on cloud infrastructure workflow.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and the rubric clause being applied.
• Strong attention to detail and flagging issues with prompts.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate model outputs against a rubric and assign severity tags.
• Compare paired responses and write a rationale for the stronger answer.
• Label hallucinations and unsafe content with structured tags.
• Document recurring failure modes for model training.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Cloud Infrastructure Workflow evaluate

Code review

Software testing

Agent evaluation

Cloud

Infrastructure

Job description

AuraOne, Inc. is seeking a Cloud Infrastructure Workflow Reviewer to evaluate cloud infrastructure workflow model outputs. You will assign severity tags and provide written rationales for comparisons between responses.

This remote role requires prior evaluation or annotation experience, attention to detail, and reliable availability for at least 10 hours weekly. Successful candidates will help ensure high-quality outputs for AI data.