Remote Business Analyst: AI Chatbot Evaluations

Weekday AI; United States; Remote; USD 34,000 - 48,000; Full time

Benefits offered by this job

Fully remote

Job summary

Weekday AI is seeking detail-oriented Business Analysts – US Raters to participate in a remote, short-term contract. You will review and compare chatbot outputs, assess quality against criteria, and produce objective final judgments within an 8-hour daily schedule and 4-hour overlap with PST.

This 16-week engagement requires a 3+ year background in business analysis, strong communication, and proficiency with Excel/SQL/BI tools.

Qualifications

• Bachelor's degree and 3+ years of business analysis or related experience.
• Strong analytical thinking, problem-solving, and communication skills.
• Proficiency with Excel, SQL and BI tools; experience with requirements gathering.

Responsibilities

• Review and compare responses generated by multiple AI chatbots.
• Evaluate chatbot outputs against predefined criteria for accuracy and quality.
• Gather and translate business requirements into evaluation guidelines.
• Conduct structured assessments and provide objective, evidence-based judgments.
• Analyze workflows and data to identify gaps and improvements.
• Prepare reports and communicate findings to project teams.

Skills

Analytical thinking

Problem solving

Decision making

Communication

Attention to detail

Independent work

Cross-functional collaboration

Agile/Scrum

Education

Bachelor's degree in Business Administration, Finance, Computer Science, or related field

Tools

Excel

SQL

Power BI

Tableau

Job description

Weekday AI is seeking detail-oriented Business Analysts – US Raters to participate in a remote, short-term contract. You will review and compare chatbot outputs, assess quality against criteria, and produce objective final judgments within an 8-hour daily schedule and 4-hour overlap with PST.

This 16-week engagement requires a 3+ year background in business analysis, strong communication, and proficiency with Excel/SQL/BI tools.