AI prompt and quality engineer

CoinMarketCap; Penang; On-site; MYR 100,000 - 150,000; Full time

Job summary

A leading company in the AI technology space is seeking a Quality Assurance Specialist for their AI Chatbot. The role involves optimizing chatbot performance through rigorous quality monitoring, collaboration with engineering teams, and data analysis to improve user interactions. Ideal candidates will have a knack for problem-solving in fast-paced environments, along with technical expertise in AI mechanisms.

Qualifications

• Solid understanding of AI Chatbot mechanisms and quality evaluation criteria.
• Foundational knowledge of NLP and Machine Learning.
• Experience with industry-leading AI Chatbot products is a strong plus.

Responsibilities

• Conduct daily quality assurance on AI Chatbot responses through manual sampling.
• Collaborate with engineering teams to optimize AI models.
• Collect and analyze user-conversation data for optimization insights.

Skills

Data Analysis

AI Chatbot Mechanisms

Quality Evaluation

Communication

Problem Solving

Education

2+ years of relevant experience

Tools

SQL

Excel

Job description

Responsibilities

• Quality Monitoring: Conduct daily quality assurance on AI Chatbot responses through manual sampling and user feedback to assess accuracy, relevance, and naturalness
• Issue Resolution: Detect response-quality issues promptly; document root causes, propose actionable improvements, and follow through to closure
• Model Tuning: Collaborate with engineering teams to optimize AI models by participating in data annotation, parameter adjustment, and other enhancement tasks to boost performance and answer quality
• Data Analysis: Collect and analyze user-conversation data to uncover user needs and pain points, providing data-driven insights for optimization
• Process Improvement: Refine quality-control workflows to increase efficiency and ensure standardization of QA and tuning processes
  
  
  

Requirements

• Technical Skills
• Solid understanding of AI Chatbot mechanisms and quality-evaluation criteria
• Basic data-analysis skills; proficient in SQL, Excel, and related tools
• Foundational knowledge of Natural Language Processing (NLP) and Machine Learning
• Experience
• 2+ years of relevant experience; prior optimization experience with AI or conversational products is preferred
• Experience with industry-leading AI Chatbot products is a strong plus
• Soft Skills
• Strong communication and collaboration abilities
• Meticulous, patient, and adept at identifying and solving problems
• Thrives in a fast-paced environment and demonstrates a strong learning aptitude