Remote AI Evaluation Analyst – Chatbot Quality & Insights

Codefeast; United States; Remote; USD 34,000 - 49,000; Full time

Job summary

Codefeast is seeking experienced Business Analysts to evaluate chatbot responses and translate insights into structured assessments. You will analyze business requirements, workflows, and processes, then prepare reports, documentation, and recommendations.

Your work will focus on assessing output accuracy, relevance, and quality while delivering clear feedback based on established guidelines. This remote US-based role requires 3+ years of analyst experience, strong analytical and communication

Qualifications

• Bachelor’s degree in Business Administration, Finance, Computer Science, or a related field.
• 3+ years of Business Analyst or relevant experience.
• Proficiency in Excel, SQL, Power BI, Tableau, or similar tools.
• Strong analytical, problem-solving, and communication skills.
• Experience with requirements gathering and process mapping.
• Knowledge of Agile or Scrum is an advantage.

Responsibilities

• Compare and evaluate multiple chatbot responses.
• Analyze business requirements, workflows, and processes.
• Prepare reports, documentation, and recommendations.
• Assess outputs for accuracy, relevance, and quality.
• Provide clear, structured feedback based on evaluation guidelines.

Skills

Analytical thinking

Communication skills

Requirements gathering

Process mapping

Education

Bachelor's degree in Business Administration, Finance, Computer Science, or a related field

Tools

Excel

SQL

Power BI

Tableau

Job description

Codefeast is seeking experienced Business Analysts to evaluate chatbot responses and translate insights into structured assessments. You will analyze business requirements, workflows, and processes, then prepare reports, documentation, and recommendations.

Your work will focus on assessing output accuracy, relevance, and quality while delivering clear feedback based on established guidelines. This remote US-based role requires 3+ years of analyst experience, strong analytical and communication