LLM Evaluation Analyst | $30/hr Remote

Crossing Hurdles; United States; Remote; USD 34,000 - 49,000; Part time

Job summary

Crossing Hurdles is seeking a Business Analyst for remote, short-term work to evaluate chatbot responses and support AI quality improvements. You will perform structured evaluations, analyze outputs, and provide clear, data-driven assessments to guide enhancements.

The candidate should hold a Bachelor's degree in a related field, demonstrate strong analytical and communication skills, and be proficient with Excel, SQL, Power BI, and Tableau, including process mapping and documentation.

Qualifications

• Bachelor's degree in a related field or equivalent.
• Strong analytical, problem-solving, and communication skills.
• Experience with data analysis and requirements gathering.
• Proficiency in Excel, SQL, Power BI or Tableau.

Responsibilities

• Evaluate and compare chatbot responses against defined criteria.
• Analyze outputs and conduct structured evaluations.
• Provide clear assessments to improve AI response quality.
• Collaborate with cross-functional teams to enhance evaluation processes.

Skills

Analytical thinking

Problem solving

Communication

Education

Bachelor's degree in Business Administration, Finance, Computer Science, or related field

Tools

Excel

SQL

Power BI

Tableau

Job description

• Evaluate and compare chatbot responses against defined criteria.
• Analyze outputs and conduct structured evaluations.
• Provide clear assessments to improve AI response quality.
• Collaborate with cross-functional teams to enhance evaluation processes.

Position: Business Analyst

Type: Short-term contractor

Compensation: Up to $30/hour

Location: Remote

Commitment: 10-40 hrs/week

Role Responsibilities

• Evaluate and compare chatbot responses against defined criteria.
• Analyze outputs and conduct structured evaluations.
• Provide clear assessments to improve AI response quality.
• Collaborate with cross-functional teams to enhance evaluation processes.

Requirements

• Hold a Bachelor s degree in Business Administration, Finance, Computer Science, or a related field.
• Demonstrate strong relevant experience as a Business Analyst or in a similar role.
• Exhibit strong analytical, problem-solving, and communication skills.
• Show proficiency in Excel, SQL, Power BI, Tableau, or similar tools.
• Have experience in requirements gathering, process mapping, and documentation.