Business Analyst: Non-US Raters

Weekday AI; Comisión de Fomento de Perú; Hybrid; ARS 25,820,000 - 36,774,000; Full time

Job summary

Weekday AI seeks detail-oriented Business Analysts – Non-US Raters to evaluate AI chatbot outputs against predefined criteria. This fully remote, 16-week contract requires 8 hours daily with overlap to US Pacific Time, five days per week, possibly including weekends.

You will review responses, apply evaluation guidelines, and document judgments with accuracy, contributing to improved AI response quality and reliability.

Qualifications

• Bachelor's degree in Business Administration, Finance, Computer Science, or a related field.
• At least 3 years of experience as a Business Analyst or in a similar analytical role.
• Strong analytical thinking, problem-solving, and decision-making abilities.
• Excellent written communication skills and the ability to explain findings clearly.
• Strong attention to detail and the ability to assess information objectively.
• Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or comparable analytical tools.
• Experience with requirement gathering, process mapping, and business documentation.
• Ability to work independently, manage multiple priorities, and meet strict deadlines.
• Strong documentation skills and the ability to follow structured evaluation guidelines.
• Familiarity with Agile or Scrum methodologies is an advantage.
• Willingness to commit to a full-time, 16-week remote engagement with the required time-zone overlap.

Responsibilities

• Review, analyze, and compare responses generated by multiple AI chatbots against predefined evaluation criteria.
• Conduct structured assessments to determine the accuracy, relevance, completeness, clarity, and overall quality of chatbot responses.
• Analyze business requirements and translate them into clear evaluation guidelines and functional specifications.
• Gather, interpret, and document relevant information to support consistent and objective assessments.
• Examine workflows, processes, and data to identify gaps, inconsistencies, and opportunities for improvement.
• Prepare evaluation reports, summaries, and supporting documentation with a strong focus on accuracy.
• Collaborate with project managers and cross-functional teams to clarify requirements and resolve evaluation-related questions.
• Track task progress, quality metrics, and project deliverables while meeting established deadlines.
• Identify recurring response-quality issues and provide actionable observations based on the defined assessment framework.
• Maintain consistency, confidentiality, and high-quality standards throughout the evaluation process.

Skills

Analytical thinking

Problem-solving

Decision-making

Written communication

Attention to detail

Independent work

Multitasking

Documentation

Education

Bachelor's degree in Business Admin/Finance/CS

Tools

Microsoft Excel

SQL

Power BI

Tableau

Job description

This role is for one of our clients

We are seeking detail-oriented and analytical Business Analysts – Non-US Raters to support a project focused on evaluating and comparing responses generated by multiple AI chatbots. The role involves reviewing chatbot outputs, applying predefined evaluation criteria, conducting structured assessments, and delivering accurate, well-documented judgments.

Candidates should have strong analytical skills, business analysis experience, attention to detail, and the ability to work independently in a remote, fast-paced environment. This opportunity is suitable for professionals interested in contributing to AI evaluation and improving the quality, relevance, and reliability of AI-generated responses.

Job Details

• Role: Business Analyst – Non-US Raters


• Experience: 3+ years


• Employment Type: Short-term contract


• Contract Duration: 16 weeks


• Location: Argentina, Peru, Mexico, Brazil, Chile, Colombia, India, and Pakistan


• Compensation: USD 15 per hour


• Start Date: Immediate


• Work Mode: Fully remote


• Availability: Full-time commitment of 8 hours per day


• Time Zone Requirement: Minimum 4 hours of overlap with the US Pacific Time (PST) time zone


• Work Schedule: Five working days per week, including weekends when required, with two weekdays off

Key Responsibilities

• Review, analyze, and compare responses generated by multiple AI chatbots against predefined evaluation criteria.


• Conduct structured assessments to determine the accuracy, relevance, completeness, clarity, and overall quality of chatbot responses.


• Analyze business requirements and translate them into clear evaluation guidelines and functional specifications.


• Gather, interpret, and document relevant information to support consistent and objective assessments.


• Examine workflows, processes, and data to identify gaps, inconsistencies, and opportunities for improvement.


• Prepare evaluation reports, summaries, and supporting documentation with a strong focus on accuracy.


• Collaborate with project managers and cross-functional teams to clarify requirements and resolve evaluation-related questions.


• Track task progress, quality metrics, and project deliverables while meeting established deadlines.


• Identify recurring response-quality issues and provide actionable observations based on the defined assessment framework.


• Maintain consistency, confidentiality, and high-quality standards throughout the evaluation process.

Required Qualifications and Skills

• Bachelor's degree in Business Administration, Finance, Computer Science, or a related field.


• At least 3 years of experience as a Business Analyst or in a similar analytical role.


• Strong analytical thinking, problem-solving, and decision-making abilities.


• Excellent written communication skills and the ability to explain findings clearly.


• Strong attention to detail and the ability to assess information objectively.


• Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or comparable analytical tools.


• Experience with requirement gathering, process mapping, and business documentation.


• Ability to work independently, manage multiple priorities, and meet strict deadlines.


• Strong documentation skills and the ability to follow structured evaluation guidelines.


• Familiarity with Agile or Scrum methodologies is an advantage.


• Willingness to commit to a full-time, 16-week remote engagement with the required time-zone overlap.

Engagement Benefits

• Opportunity to contribute to projects focused on AI evaluation and response quality.


• Fully remote work arrangement with the flexibility of working from your location.


• Exposure to structured AI assessment workflows and quality evaluation processes.


• Opportunity to contribute to projects with international reach.


• Clearly defined contract duration, hourly compensation, and evaluation responsibilities.

Important Engagement Details

• This is a project-based contract lasting 16 weeks.


• Work will consist of evaluating multiple chatbot responses and submitting a final assessment for each assigned task.


• Candidates must be available for 8 hours per day, five days per week, with four hours of overlap with US Pacific Time.


• The schedule may include weekend work, with two weekdays off each week.


• Candidates are expected to maintain consistent evaluation quality, follow project guidelines, and complete assigned tasks within the required timelines.