Senior CSR for AI Training & Evaluation

Appsierra Group; American Samoa; On-site; USD 67,000 - 144,000; Full time

Benefits offered by this job

Fully remote

Independent contractor engagement

Flexible, asynchronous work

Job summary

Appsierra Group is seeking experienced Customer Service Representatives and support professionals to design and evaluate realistic customer service scenarios used to train AI systems. The role focuses on empathy, problem-solving, and policy interpretation across multiple channels, with a fully remote contract engagement.

You will create questions, assess AI responses for tone and practicality, and provide actionable feedback to refine evaluation criteria in collaboration with specialists.

Qualifications

• High school diploma or equivalent required or preferred.
• Associate or bachelor’s degree preferred.
• Proven experience in customer service or support roles.
• Strong written and verbal communication skills.
• Ability to evaluate interactions objectively and provide clear reasoning.

Responsibilities

• Create and evaluate realistic customer service scenarios used to train and assess AI systems.
• Develop questions and case studies covering conflict resolution, troubleshooting, complaints, empathy, and policy interpretation.
• Evaluate AI-generated responses for accuracy, tone, usefulness, and practicality.
• Provide detailed feedback explaining why responses are effective or need improvement.
• Collaborate with specialists to refine scenario difficulty and evaluation criteria.

Skills

Communication

Analytical thinking

Problem-solving

Empathy

Customer experience

Education

High school diploma or equivalent

Associate or bachelor’s degree preferred

Tools

CRM systems

Job description

Appsierra Group is seeking experienced Customer Service Representatives and support professionals to design and evaluate realistic customer service scenarios used to train AI systems. The role focuses on empathy, problem-solving, and policy interpretation across multiple channels, with a fully remote contract engagement.

You will create questions, assess AI responses for tone and practicality, and provide actionable feedback to refine evaluation criteria in collaboration with specialists.