QA Engineer (Digital Human & LLM/ Chatbot)

Pantheon Lab Limited; Hong Kong; On-site; HKD 180,000 - 300,000; Full time

Job summary

Pantheon Lab Limited is seeking a QA Engineer (Digital Human & LLM/ Chatbot) in Hong Kong. The role blends manual exploratory testing with internal test automation to validate software features, UI flows, and integration with STT, TTS, and LLM engines across cloud servers, kiosks, mobile apps, and on‑premise hardware.

Responsibilities include end-to-end solution testing, API testing, automation framework development, and collaboration with AI, software, and PMO teams.

Qualifications

• 1–4 years in software testing (junior to mid-level).
• Experience with functional/solution testing across software and hardware.
• Proficiency in API testing and automated test scripts.
• Strong English, Cantonese and Mandarin communication skills.

Responsibilities

• Own the functional testing lifecycle for features and UI components.
• Validate end-to-end software-hardware integration including kiosks and cloud layers.
• Test STT and TTS components for accuracy and lip-sync alignment.
• Evaluate LLM workflows, chatbot logic and multi-language interactions.
• Develop and maintain automated test scripts for cloud APIs and pipelines.
• Monitor cloud/server logs and triage alerts; escalate issues as needed.
• Collaborate daily with AI, software, and PMO teams to track bug lifecycles.

Skills

Manual testing

Automation testing

API testing

Cloud platforms

GitHub

Jira

Multilingual comms

Tools

Automated test frameworks

Web/mobile automation

APIs testing tools

Docker/Kubernetes

Job description

QA Engineer (Digital Human & LLM/ Chatbot)

Join our team to validate cutting-edge, hyper-realistic Digital Human ecosystems and Agentic AI solutions. In this junior-to-mid-level role, you will perform a blend of manual exploratory testing and internal test automation. Your primary focus will be comprehensive functional software and solution testing—ensuring that all system features, user flows, and application functions work flawlessly alongside our core Speech-to-Text (STT), Text-to-Speech (TTS), and LLM engines across cloud servers, interactive Kiosks, mobile apps, web interfaces, and on-premise hardware.

Key Responsibilities

• Full-Feature Functional Testing: Own the functional testing lifecycle. Thoroughly test all software features, UI components, user navigation buttons, and operational flows to ensure the application behaves exactly as expected.
• End-to-End Solution Testing: Validate the complete software-hardware integration loop. Ensure seamless data flows from physical user inputs on Kiosk/Web interfaces, through cloud-hosted AI layers, and back to the physical display output.
• Validate Audio & Speech Components: Test Speech-to-Text (STT) transcription accuracy and Text-to-Speech (TTS) naturalness, pronunciation, and real-time lip-sync alignment within the live environment.
• Test AI & Interaction Logic: Design and execute test matrices to evaluate LLM conversational branches, chatbot logic, and agentic workflows for multi-language accuracy, context retention, and low latency.
• Build Internal Automation Frameworks: Develop, maintain, and execute automated test scripts targeting cloud APIs, communication pipelines, and core functional software modules to accelerate release cycles.
• Monitor Cloud, Infrastructure & Alerts: Actively watch cloud server metrics and system monitoring dashboards. Triage automated infrastructure or software alerts, investigate log files, and initiate immediate escalation paths for system anomalies.
• Cross-Functional PMO Collaboration: Act as the primary QA anchor working daily with AI, Software, and the PMO teams to track bug resolution lifecycles and ensure software releases hit key milestones.
• Experience: 1 to 4 years of proven experience in software testing and complex functional/solution testing (Junior to Mid-Level).
• Functional & Feature Testing Mastery: Strong background in breaking down complex business requirements into detailed manual and automated test cases that cover 100% of application features and user edge cases.
• Solution Testing Frameworks: Demonstrated ability to test multi-tier solutions where software interacts directly with cloud systems, APIs, and physical endpoints (Kiosks/devices).
• API & System Validation: Solid experience with automated API testing tools and functional web/mobile automation frameworks
• Cloud Platform Familiarity: Hands-on experience navigating cloud platforms to verify hosted software components, server logs, and deployment environments.
• Monitoring & Alerting Systems: Direct experience working with telemetry, system monitoring, or cloud logging tools to track software health and react to real-time system alerts.
• Agile Workflows & Collaboration: Active usage of GitHub for version control, along with Jira or similar issue-tracking tools inside structured Agile frameworks.
• Excellent English, Cantonese, Mandarin communication skills (written, reading, and verbal)
• Ability to explain complex technical concepts to both technical and non-technical audiences
• Strong problem-solving and analytical thinking capabilities
• Self-motivated with ability to work independently and drive projects to completion
• Collaborative team player who thrives in fast-paced environments

Good to Have

• AI Ecosystem Knowledge: Conceptual or hands-on exposure to AI Frameworks (LangChain, LlamaIndex), speech processing APIs, or LLM-based applications.
• DevOps Basics:

  Basic understanding of containerization and deployments (Docker, Kubernetes) to better diagnose environment-specific software issues.