AI Quality Engineer — LLM Safety & Validation

Dassault Systèmes; Petaling Jaya; On-site; MYR 60,000 - 90,000; Full time

Job summary

Dassault Systèmes is hiring an AI Quality Engineer in Kuala Lumpur to help build an AI Virtual Companion for Operations Planning & Optimization. You will design prompt tests, benchmark LLM performance, and automate validation at scale, ensuring safe and accurate AI outputs.

The role requires strong Python, API testing skills, and a solid AI/ML foundation. You will work with product, development, and UX teams to deliver robust AI solutions that scale across complex supply chain scenarios.

Qualifications

• Bachelor's degree or above; 2–5 years in software development within AI/ML landscape.
• Strong grasp of LLM fundamentals: tokens, temperature, top-p, context windows.
• Proficiency in Python with experience testing RESTful APIs and WebSocket connections.

Responsibilities

• Design and execute test cases using prompt engineering and adversarial testing.
• Benchmark LLM performance on hallucination rates, sentiment, and context retention.
• Build automated validation pipelines using LLM-as-a-judge patterns.
• Lead safety, bias auditing and PII leakage checks.
• Manage regression testing across model versions for stability.
• Collaborate with Product Owner, Developers, AI Engineers and UX Designers.

Skills

Python

API Testing

LLM Fundamentals

Education

Bachelor's degree or above

Tools

RESTful APIs

WebSockets

Job description

Dassault Systèmes is hiring an AI Quality Engineer in Kuala Lumpur to help build an AI Virtual Companion for Operations Planning & Optimization. You will design prompt tests, benchmark LLM performance, and automate validation at scale, ensuring safe and accurate AI outputs.

The role requires strong Python, API testing skills, and a solid AI/ML foundation. You will work with product, development, and UX teams to deliver robust AI solutions that scale across complex supply chain scenarios.