AI QA Engineer: Testing & Evaluation of AI‑Driven Products

RUNJIAN (M) SDN. BHD.; Kuala Lumpur; On-site; MYR 60,000 - 100,000; Full time

Job summary

RUNJIAN (M) SDN. BHD. is hiring a Test Engineer to own QA and AI evaluation for AI+Energy and AI+Education products localized for Malaysia and ASEAN markets.

You will design, build, and run tests and evaluations, bridging an AI-first engineering team and real-world users. The role is hands-on and contributor-based, with responsibilities spanning test strategy, automation, data environments, and localization QA, reporting to the AI-focused product team.

Qualifications

• 3+ years of software testing / QA experience with real products.
• Hands-on test automation experience (e.g., Playwright, Cypress, Selenium, pytest, or similar) and API testing skills.
• Basic scripting ability (Python, TypeScript, or similar) — enough to build tooling, not production features.
• Curiosity about AI systems: willingness to learn how LLMs fail and how to measure their behavior.
• Attention to detail, structured thinking, and clear communication skills in English.

Responsibilities

• Product QA: Own test strategy and execution for functional, regression, integration, and acceptance testing across web UI, APIs, and data pipelines.
• Test Automation: Build and maintain automated test suites integrated into CI/CD for both human-written and AI-generated code.
• AI Evaluation: Design and run quality gates for AI-generated code and build evaluation sets for LLM-driven features.
• Data & Environments: Manage test data and staging environments, including realistic energy-domain data sets; triage bugs and verify fixes.
• Localization QA: Verify English UI copy and Malaysian/ASEAN localization quality with the Product UI Engineer.
• Field Feedback Loop: Reproduce and regression-test issues found at customer sites with delivery engineers.

Skills

Test automation

API testing

Scripting (Python/TypeScript)

English communication

AI/LLM evaluation familiarity

Tools

Playwright

Cypress

Selenium

pytest

Job description

RUNJIAN (M) SDN. BHD. is hiring a Test Engineer to own QA and AI evaluation for AI+Energy and AI+Education products localized for Malaysia and ASEAN markets.

You will design, build, and run tests and evaluations, bridging an AI-first engineering team and real-world users. The role is hands-on and contributor-based, with responsibilities spanning test strategy, automation, data environments, and localization QA, reporting to the AI-focused product team.