Remote AI Chatbot Evaluation Analyst (Contract)

Zettamine Labs; United States; Remote; USD 12,000 - 17,000; Full time

Job summary

ZettaMine is hiring a Business Analyst (Non-US Raters) for a short-term AI training and evaluation project across India. This remote contractor role requires 3+ years of BA experience, strong Excel/SQL/BI skills, and the ability to evaluate chatbot outputs against defined criteria.

Work is 16 weeks, immediate start, with 8 hours daily and PST overlap. Rate is $10 USD per hour. Laptop and internet are required; candidates must document findings clearly and collaborate with cross-functional teams.

Qualifications

• Experience in business analysis, requirement gathering, and process mapping.
• Ability to analyze business requirements, workflows, processes, and data.
• Strong documentation skills with attention to detail and accuracy.
• Ability to evaluate multiple chatbot responses and compare outputs against criteria.
• Ability to provide structured assessments and evidence-based conclusions.
• Ability to work with cross-functional teams and manage priorities.
• Knowledge of Agile or Scrum methodologies is a plus.

Responsibilities

• Evaluate and compare responses generated by multiple chatbots.
• Analyze chatbot outputs against predefined business requirements and evaluation criteria.
• Assess response quality, relevance, accuracy, completeness, and consistency.
• Conduct structured evaluations and provide final assessments per guidelines.
• Identify gaps, inconsistencies, and areas for improvement in chatbot responses.
• Analyze business scenarios to ensure chatbot answers meet requirements.
• Apply analytical reasoning and document observations clearly.
• Follow standardized evaluation procedures for consistency.
• Meet productivity targets and project deadlines.

Skills

Excel

SQL

Power BI

Tableau

Analytical skills

Requirement gathering

Process mapping

Documentation

Chatbot evaluation

Cross-functional teamwork

Agile/Scrum awareness

Education

Bachelor's degree in Business Administration, Finance, Computer Science, or related

Tools

Excel

SQL

Power BI

Tableau

Job description

ZettaMine is hiring a Business Analyst (Non-US Raters) for a short-term AI training and evaluation project across India. This remote contractor role requires 3+ years of BA experience, strong Excel/SQL/BI skills, and the ability to evaluate chatbot outputs against defined criteria.

Work is 16 weeks, immediate start, with 8 hours daily and PST overlap. Rate is $10 USD per hour. Laptop and internet are required; candidates must document findings clearly and collaborate with cross-functional teams.