AI Systems QA Engineer for LLM & Automation

Plaud Inc.; Singapore; On-site; SGD 80,000 - 140,000; Full time

Benefits offered by this job

ESOP

High-Impact Environment

AI Tools Access

Top-spec Equipment

Team Offsites

Medical Insurance

Job summary

Plaud Inc. is seeking a QA Engineer to own end-to-end testing of a large server-side architecture and AI-powered features. You will evaluate AI systems, implement automated quality gates, and build testing tools integrated with CI/CD to ensure robust product delivery.

The role focuses on regression, performance, and data integrity across user management, billing, and AI components, driving high-quality releases in a fast-moving, product-driven environment.

Qualifications

• Experience testing large server-side architecture refactors, microservices, and messaging queues.
• Experience testing LLM/Embedding/RAG/Agent products; familiar with vector-retrieval systems (Elasticsearch/Faiss/Milvus) and inference frameworks (vLLM/Triton).
• Familiar with automation frameworks (Selenium/Playwright/Pytest) and Kubernetes/Docker; established QA methodology for AI products.

Responsibilities

• Server-Side & Architecture QA Full-Lifecycle Testing for core server modules (e.g., user management, billing). Migration safeguards: lead API regression, data-consistency checks, and service-degradation drills during architecture upgrades.
• AI System & Algorithm Evaluation: AI Search & Recs; design quality gates for Retrieval/Memory systems, long-tail recall, and embedding drift.
• AI Infra & Model Release: drive testing for Context OS through capacity assessment and chaos drills; build automated quality gates for model releases. AI Agent Testing: formulate automated evaluation for AI Agents, covering multi-turn dialogue, tool calling, and error recovery.
• Test Engineering & Automation Tool Development: independently develop and roll out custom automated testing tools based on business needs. Scripting & CI/CD: rapidly produce automation/performance scripts and integrate Agent testing pipelines into CI/CD.

Skills

Server-side testing

LLM/Embedding testing

Automation frameworks

Kubernetes/Docker

Tools

Elasticsearch

Faiss

Milvus

vLLM

Triton

Selenium

Playwright

Pytest

Docker

Kubernetes

Job description

Plaud Inc. is seeking a QA Engineer to own end-to-end testing of a large server-side architecture and AI-powered features. You will evaluate AI systems, implement automated quality gates, and build testing tools integrated with CI/CD to ensure robust product delivery.

The role focuses on regression, performance, and data integrity across user management, billing, and AI components, driving high-quality releases in a fast-moving, product-driven environment.