Test Engineer (QA & AI Evaluation)

RUNJIAN (M) SDN. BHD.; Kuala Lumpur; Sur place; MYR 60 000 - 100 000; Plein temps

Résumé du poste

RUNJIAN (M) SDN. BHD. is hiring a Test Engineer to own QA and AI evaluation for AI+Energy and AI+Education products localized for Malaysia and ASEAN markets.

You will design, build, and run tests and evaluations, bridging an AI-first engineering team and real-world users. The role is hands-on and contributor-based, with responsibilities spanning test strategy, automation, data environments, and localization QA, reporting to the AI-focused product team.

Qualifications

• 3+ years of software testing / QA experience with real products.
• Hands-on test automation experience (e.g., Playwright, Cypress, Selenium, pytest, or similar) and API testing skills.
• Basic scripting ability (Python, TypeScript, or similar) — enough to build tooling, not production features.
• Curiosity about AI systems: willingness to learn how LLMs fail and how to measure their behavior.
• Attention to detail, structured thinking, and clear communication skills in English.

Responsabilités

• Product QA: Own test strategy and execution for functional, regression, integration, and acceptance testing across web UI, APIs, and data pipelines.
• Test Automation: Build and maintain automated test suites integrated into CI/CD for both human-written and AI-generated code.
• AI Evaluation: Design and run quality gates for AI-generated code and build evaluation sets for LLM-driven features.
• Data & Environments: Manage test data and staging environments, including realistic energy-domain data sets; triage bugs and verify fixes.
• Localization QA: Verify English UI copy and Malaysian/ASEAN localization quality with the Product UI Engineer.
• Field Feedback Loop: Reproduce and regression-test issues found at customer sites with delivery engineers.

Connaissances

Test automation

API testing

Scripting (Python/TypeScript)

English communication

AI/LLM evaluation familiarity

Outils

Playwright

Cypress

Selenium

pytest

Description du poste

The ASEAN AI Innovation Centre is the overseas R&D hub of our AI Business Group, localizing mature AI products from China and building new AI products for Malaysia and broader ASEAN markets, with a focus on energy and education.

We are hiring a Test Engineer with a dual mandate. First, classic product QA: making sure our AI+Energy and AI+Education products work correctly for real enterprise users. Second — and this is what makes the role unusual — AI evaluation: our team uses AI coding agents daily, and our products themselves contain LLM-driven features. Both need systematic quality gates, and you will own them.

You will be the quality counterpart to an AI-first engineering team: designing the checks that AI‑generated code must pass before it ships, and the evaluation sets that tell us whether an AI product feature actually behaves reliably. This is a hands‑on role with a direct line to how the whole team works, not a downstream checkbox. This is a hands‑on individual‑contributor role — you design, build, and run the tests and evaluations yourself.

KEY RESPONSIBILITIES

• Product QA: Own test strategy and execution for the Centre’s products: functional, regression, integration, and acceptance testing across web UI, APIs, and data pipelines.
• Test Automation: Build and maintain automated test suites integrated into CI/CD, so that both human-written and AI‑generated code is verified continuously.
• AI Evaluation: Design and run quality gates for AI‑generated code together with the architecture track. Build evaluation sets for LLM‑driven product features: accuracy, consistency, regression across prompt and model changes, and human review checkpoints for critical paths.
• Data & Environments: Manage test data and staging environments, including realistic energy-domain data sets; triage bugs and verify fixes.
• Localization QA: Walk through English UI copy and localized flows for Malaysian and ASEAN users; verify localization quality with the Product UI Engineer.
• Field Feedback Loop: Work with delivery engineers to reproduce and regression‑test issues found at customer sites.

WHAT YOU MUST BRING

• 3+ years of software testing / QA experience with real products.
• Hands‑on test automation experience (e.g., Playwright, Cypress, Selenium, pytest, or similar) and API testing skills.
• Basic scripting ability (Python, TypeScript, or similar) — enough to build tooling, not production features.
• Curiosity about AI systems: willingness to learn how LLMs fail and how to measure their behavior. Prior AI/LLM evaluation experience is a plus, not a prerequisite.
• Attention to detail, structured thinking, and clear communication skills in English.

WHAT YOU CAN LEARN HERE

• AI evaluation methodology: evaluation set design, LLM behavior testing, and quality gates for AI‑generated code — one of the most in‑demand emerging QA skills.
• Modern automation practices in an AI‑first CI/CD pipeline.
• Energy and education domain knowledge across Southeast Asian markets.

LANGUAGE

Proficiency in English is essential. Proficiency in (Mandarin) is strongly preferred. Malay is a plus for on‑site work and local coordination.

"We are looking for Mandarin‑speaking candidates who will be serving Mandarin‑speaking customers."

WHY JOIN US

• Founding team opportunity: join a brand‑new AI R&D centre in its first year and shape how it builds software.
• AI‑first team culture: every team member uses AI tools daily; you will work alongside AI coding agents, not just other engineers.
• Work with frontier AI models on real industry problems in energy and education across Southeast Asia.
• 3-year strategic incubation: no short‑term revenue pressure. Focus on building the right products and the right skills.

TEAM CONTEXT

In Year 1 the Centre is a compact full‑time team of 15. You will report to the two Senior Software Engineers (platform and integration tracks) and work daily with the AI‑Native Product Manager, the Product UI Engineer, the delivery team, and AI coding agents. Engineering interns will work alongside you on evaluation and internal tooling.