AI Quality Analyst - Remote US Raters (Contract)

Weekday; Oregon; Hybrid; USD 34,000 - 49,000; Part time

Benefits offered by this job

Fully remote

Job summary

Weekday is seeking a detail-oriented Business Analyst to support a US-based AI-evaluation project. You will review and compare chatbot responses, document criteria, and translate findings into clear guidelines for assessments.

The ideal candidate has 3+ years in business analysis, strong Excel/SQL/BI skills, and the ability to work independently in a fully remote, 16-week contract with 8-hour daily commitments and PST overlap.

Qualifications

• Bachelor's degree or higher in a related field.
• 3+ years of BA or analytical experience.
• Proficient with Excel and data tools; SQL, BI tools.
• Strong written and verbal communication; ability to document requirements.

Responsibilities

• Review, analyze, and compare chatbot responses.
• Evaluate responses against predefined criteria (accuracy, relevance, completeness, clarity, consistency).
• Gather and document business requirements; translate into evaluation guidelines.
• Conduct structured assessments and provide evidence-based judgments.
• Analyze workflows and data to identify gaps and improvements.
• Prepare reports and summaries communicating findings.
• Collaborate with project managers and cross-functional teams.
• Track progress, metrics, and deliverables to ensure timely completion.
• Identify recurring issues and share actionable observations.
• Maintain accuracy, confidentiality, and documentation standards.

Skills

Analytical thinking

Problem-solving

Decision-making

Communication

Education

Bachelor's degree in Business Administration, Finance, Computer Science, or related field

Tools

Excel

SQL

Power BI

Tableau

Job description

Weekday is seeking a detail-oriented Business Analyst to support a US-based AI-evaluation project. You will review and compare chatbot responses, document criteria, and translate findings into clear guidelines for assessments.

The ideal candidate has 3+ years in business analysis, strong Excel/SQL/BI skills, and the ability to work independently in a fully remote, 16-week contract with 8-hour daily commitments and PST overlap.