AI QA Specialist : 26-02687

Akraya, Inc.; Charlotte (NC); Hybrid; USD 42,000 - 58,000; Full time

Job summary

Akraya, Inc. is seeking a Generative AI Evaluation Specialist to rigorously test and improve AI-powered customer assistance tools in a hybrid Charlotte, NC environment.

You will analyze user interactions, identify enhancement opportunities, and collaborate with cross-functional teams to refine AI responses while ensuring high-quality, compliant user experiences in a regulated setting.

Qualifications

• Strong analytical and evaluative skills.
• Excellent attention to detail and organizational abilities.
• Effective verbal and written communication.
• Experience in a financial institution or other highly regulated environment is preferred.

Responsibilities

• Assess AI interactions for errors and user satisfaction trends.
• Collaborate with various teams to pinpoint and resolve AI response issues.
• Contribute to the continuous improvement of AI-generated content.
• Analyze user feedback to understand satisfaction and dissatisfaction drivers.
• Apply security policy intent to diverse AI interaction scenarios.

Skills

Generative AI evaluation

Data Analysis

Quality assurance

Customer Service

CRM platforms

Job description

Primary Skills: Generative AI evaluation (Advanced), Data Analysis (Advanced), Quality assurance (Advanced), Customer Service (Expert), CRM platforms (Intermediate), Contract Type: W2 Contract Duration: 10+ Months Location: Charlotte NC (#LI-Hybrid) Pay Range: $20.00 - $28.00 Per Hour #LP

Job Summary:

This role focuses on rigorously testing and improving generative AI-powered customer assistance tools. You will analyze user interactions to identify areas for enhancement and collaborate with teams to refine AI responses. The goal is to ensure a high-quality, helpful, and satisfying experience for users.

Key Responsibilities:

• Assess AI interactions for errors and user satisfaction trends.
• Collaborate with various teams to pinpoint and resolve AI response issues.
• Contribute to the continuous improvement of AI-generated content.
• Analyze user feedback to understand satisfaction and dissatisfaction drivers.
• Apply security policy intent to diverse AI interaction scenarios.

Must-Have Skills:

• Strong analytical and evaluative skills.
• Excellent attention to detail and organizational abilities.
• Effective verbal and written communication.
• Experience in a financial institution or other highly regulated environment is preferred.