Generative AI Quality Assurance Analyst (Hybrid)

Akraya, Inc.; Charlotte (NC); Hybrid; USD 42,000 - 58,000; Full time

Job summary

Akraya, Inc. is seeking a Generative AI Evaluation Specialist to rigorously test and improve AI-powered customer assistance tools in a hybrid Charlotte, NC environment.

You will analyze user interactions, identify enhancement opportunities, and collaborate with cross-functional teams to refine AI responses while ensuring high-quality, compliant user experiences in a regulated setting.

Qualifications

• Strong analytical and evaluative skills.
• Excellent attention to detail and organizational abilities.
• Effective verbal and written communication.
• Experience in a financial institution or other highly regulated environment is preferred.

Responsibilities

• Assess AI interactions for errors and user satisfaction trends.
• Collaborate with various teams to pinpoint and resolve AI response issues.
• Contribute to the continuous improvement of AI-generated content.
• Analyze user feedback to understand satisfaction and dissatisfaction drivers.
• Apply security policy intent to diverse AI interaction scenarios.

Skills

Generative AI evaluation

Data Analysis

Quality assurance

Customer Service

CRM platforms

Job description

Akraya, Inc. is seeking a Generative AI Evaluation Specialist to rigorously test and improve AI-powered customer assistance tools in a hybrid Charlotte, NC environment.

You will analyze user interactions, identify enhancement opportunities, and collaborate with cross-functional teams to refine AI responses while ensuring high-quality, compliant user experiences in a regulated setting.