AI prompt and quality engineer - coinmarketcap

Hospitable.com; Kuala Lumpur; On-site; MYR 80,000 - 120,000; Full time

Job summary

A leading cryptocurrency data platform is looking for an AI Prompt and Quality Engineer to ensure high-quality performance of its AI chatbot products. This role includes monitoring, evaluating, and optimizing chatbot responses, conducting quality assurance, and collaborating with engineering teams. Candidates should have 2+ years of experience in AI QA-related roles, knowledge of chatbot mechanics, and proficiency in SQL and Excel.

Qualifications

• 2+ years in AI QA or chatbot-related roles.
• Familiarity with top-tier chatbot platforms.

Responsibilities

• Conduct daily manual sampling and review of chatbot interactions.
• Identify quality issues and recommend actionable improvements.
• Collaborate with engineering teams on model enhancement.
• Examine user conversations to inform optimization strategies.
• Streamline and standardize QA processes.

Skills

Knowledge of AI chatbot mechanics

Proficiency in SQL

Proficiency in Excel

Basic NLP concepts

Basic ML concepts

Detail-oriented

Communicative

Collaborative

Adaptable to fast-paced settings

Job description

AI prompt and quality engineer - coinmarketcap

Crypto Jobs

Job Description

Job Title:

AI Prompt and Quality Engineer

Employment Type: Full-Time

About the Role:

CoinMarketCap is hiring an AI Prompt and Quality Engineer to ensure high-quality performance of our AI chatbot products. This role focuses on monitoring, evaluating, and optimizing chatbot responses to enhance user experience and maintain response accuracy.

Key Responsibilities:

• Quality Assurance: Conduct daily manual sampling and review of chatbot interactions to ensure accuracy, relevance, and naturalness
• Issue Tracking: Identify quality issues, analyze root causes, and recommend actionable improvements
• Model Enhancement: Collaborate with engineering teams on prompt tuning, data annotation, and AI parameter adjustments
• Data Analysis: Examine user conversations to uncover insights and inform optimization strategies
• Workflow Improvement: Streamline and standardize QA processes to boost efficiency and consistency

Requirements:

• Technical Skills:
• Knowledge of AI chatbot mechanics and evaluation
• Proficiency in SQL, Excel; basic NLP and ML concepts
• Experience:
• 2+ years in AI QA or chatbot-related roles
• Familiarity with top-tier chatbot platforms
• Soft Skills:
• Detail-oriented, communicative, collaborative, and adaptive to fast-paced settings