Business Analyst: US Raters

Weekday; Oregon; Hybrid; USD 34,000 - 49,000; Part time

Benefits offered by this job

Fully remote

Job summary

Weekday is seeking a detail-oriented Business Analyst to support a US-based AI-evaluation project. You will review and compare chatbot responses, document criteria, and translate findings into clear guidelines for assessments.

The ideal candidate has 3+ years in business analysis, strong Excel/SQL/BI skills, and the ability to work independently in a fully remote, 16-week contract with 8-hour daily commitments and PST overlap.

Qualifications

• Bachelor's degree or higher in a related field.
• 3+ years of BA or analytical experience.
• Proficient with Excel and data tools; SQL, BI tools.
• Strong written and verbal communication; ability to document requirements.

Responsibilities

• Review, analyze, and compare chatbot responses.
• Evaluate responses against predefined criteria (accuracy, relevance, completeness, clarity, consistency).
• Gather and document business requirements; translate into evaluation guidelines.
• Conduct structured assessments and provide evidence-based judgments.
• Analyze workflows and data to identify gaps and improvements.
• Prepare reports and summaries communicating findings.
• Collaborate with project managers and cross-functional teams.
• Track progress, metrics, and deliverables to ensure timely completion.
• Identify recurring issues and share actionable observations.
• Maintain accuracy, confidentiality, and documentation standards.

Skills

Analytical thinking

Problem-solving

Decision-making

Communication

Education

Bachelor's degree in Business Administration, Finance, Computer Science, or related field

Tools

Excel

SQL

Power BI

Tableau

Job description

This role is for one of our clientsWe are looking for detail-oriented and analytical Business Analysts - US Raters to support a project focused on evaluating and comparing responses generated by multiple AI chatbots. The role involves reviewing chatbot outputs, assessing their quality against predefined criteria, conducting structured evaluations, and providing accurate, well-supported final judgments.The ideal candidate will have at least three years of experience in business analysis or a related field, strong analytical and communication skills, and the ability to evaluate information objectively. This is a fully remote, short-term contract opportunity for candidates based in the United States who can commit to the required working hours and project schedule.

Job Details

• Role: Business Analyst - US Raters
• Experience: 3+ years
• Location: United States only
• Employment Type: Short-term contract
• Contract Duration: 16 weeks
• Compensation: USD 30 per hour
• Start Date: Immediate
• Work Mode: Fully remote
• Availability: Full-time commitment of 8 hours per day
• Time Zone Requirement: At least 4 hours of overlap with US Pacific Time (PST)
• Work Schedule: Five working days per week, including weekends as required, with two weekdays off

RequirementsKey Responsibilities

• Review, analyze, and compare responses generated by multiple AI chatbots.
• Evaluate chatbot responses based on predefined criteria, including accuracy, relevance, completeness, clarity, consistency, and overall quality.
• Gather, analyze, and document business requirements and translate them into clear evaluation guidelines.
• Conduct structured assessments and provide objective, evidence-based judgments.
• Analyze workflows, processes, and data to identify gaps, inconsistencies, and areas for improvement.
• Prepare reports, summaries, and supporting documentation to communicate evaluation findings.
• Collaborate with project managers and cross-functional teams to clarify requirements and resolve assessment-related questions.
• Track task progress, quality metrics, and deliverables to ensure timely completion.
• Identify recurring issues in chatbot responses and share actionable observations.
• Maintain high standards of accuracy, consistency, confidentiality, and documentation throughout the project.

Required Qualifications and Skills

• Bachelor's degree in Business Administration, Finance, Computer Science, or a related field.
• At least 3 years of experience as a Business Analyst or in a similar analytical role.
• Strong analytical thinking, problem-solving, and decision-making skills.
• Excellent written and verbal communication skills.
• Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or similar analytical tools.
• Experience with requirement gathering, process mapping, and business documentation.
• Ability to work effectively with cross-functional teams and manage multiple priorities.
• Strong attention to detail and the ability to make consistent, objective assessments.
• Familiarity with Agile or Scrum methodologies is an advantage.
• Ability to follow detailed instructions, meet deadlines, and work independently in a remote environment.

Engagement Benefits

• Opportunity to contribute to projects focused on AI evaluation and chatbot response quality.
• Fully remote work arrangement.
• Exposure to structured AI assessment and quality assurance processes.
• Opportunity to work on projects with broader business and technological applications.
• Clearly defined contract duration, hourly compensation, and project expectations.

Important Engagement Details

• This is a project-based contract with a duration of 16 weeks.
• Assigned tasks will involve comparing responses from multiple chatbots and submitting a final assessment based on defined criteria.
• Candidates must be available for 8 hours per day, five days per week.
• A minimum of four hours of overlap with US Pacific Time is required.
• The schedule may include weekend work, with two weekdays off each week.
• Candidates must be based in the United States and comply with the applicable country-specific eligibility guidelines.
• Consistent evaluation quality, adherence to project instructions, and timely task completion are essential.