JSON Rubrics QA Analyst - Remote & Independent

Weekday 1; United States; Remote; USD 69,000 - 241,000; Full time

Benefits offered by this job

Fully remote

Flexible hours

Weekly payments

Job summary

Weekday 1 is recruiting detail-oriented evaluators to review AI-generated outputs with structured rubrics. This is a fully remote contractor role in the United States, requiring careful analysis of JSON data and adherence to evaluation guidelines.

You will review JSON-formatted outputs, apply rubric criteria, and provide evidence-based scores while meeting tight deadlines. Immediate onboarding offered with flexible hours and weekly payments where applicable.

Qualifications

• Ability to read JSON files and structured data.
• Experience applying rubrics or evaluation standards.
• Strong written communication and attention to detail.
• Ability to work independently under deadlines.

Responsibilities

• Review and understand written task descriptions and evaluation objectives.
• Interpret detailed grading rubrics and apply them consistently across assignments.
• Read, parse, and evaluate JSON-formatted AI model outputs against predefined quality criteria.
• Assign accurate, evidence-based scores while maintaining consistency across evaluations.
• Identify discrepancies, missing information, or rubric violations during the review process.
• Maintain high standards of quality, accuracy, and attention to detail while meeting project turnaround expectations.
• Complete all evaluations independently without using AI-assisted tools.

Skills

JSON literacy

Rubrics experience

Analytical thinking

Attention to detail

Written communication

Independent work

QA experience

Job description

Weekday 1 is recruiting detail-oriented evaluators to review AI-generated outputs with structured rubrics. This is a fully remote contractor role in the United States, requiring careful analysis of JSON data and adherence to evaluation guidelines.

You will review JSON-formatted outputs, apply rubric criteria, and provide evidence-based scores while meeting tight deadlines. Immediate onboarding offered with flexible hours and weekly payments where applicable.