AI Quality Engineer

Dassault Systèmes; Petaling Jaya; On-site; MYR 60,000 - 90,000; Full time

Job summary

Dassault Systèmes is hiring an AI Quality Engineer in Kuala Lumpur to help build an AI Virtual Companion for Operations Planning & Optimization. You will design prompt tests, benchmark LLM performance, and automate validation at scale, ensuring safe and accurate AI outputs.

The role requires strong Python, API testing skills, and a solid AI/ML foundation. You will work with product, development, and UX teams to deliver robust AI solutions that scale across complex supply chain scenarios.

Qualifications

• Bachelor's degree or above; 2–5 years in software development within AI/ML landscape.
• Strong grasp of LLM fundamentals: tokens, temperature, top-p, context windows.
• Proficiency in Python with experience testing RESTful APIs and WebSocket connections.

Responsibilities

• Design and execute test cases using prompt engineering and adversarial testing.
• Benchmark LLM performance on hallucination rates, sentiment, and context retention.
• Build automated validation pipelines using LLM-as-a-judge patterns.
• Lead safety, bias auditing and PII leakage checks.
• Manage regression testing across model versions for stability.
• Collaborate with Product Owner, Developers, AI Engineers and UX Designers.

Skills

Python

API Testing

LLM Fundamentals

Education

Bachelor's degree or above

Tools

RESTful APIs

WebSockets

Job description

Unlock your potential with Dassault Systèmes, a global leader in Scientific Software Engineering, as we are hiring an AI Quality Engineer in Kuala Lumpur, Malaysia!

Join us in building a next-generation AI Virtual Companion for Operation Planning & Optimization. Powered by Large Language Models (LLMs) and agentic AI, you'll help create intelligent systems that can reason, retrieve information, and act autonomously.

Role Responsibilities & Job Description:

• Prompt Engineering & Evaluation: Design and execute sophisticated test cases using prompt injection and adversarial testing to evaluate the AI's boundaries and responses.
• LLM Benchmarking: Utilize advanced frameworks to measure performance in critical areas like hallucination rates, sentiment consistency, and context retention.
• Automated Validation: Build and maintain automated pipelines that leverage "LLM-as-a-judge" patterns to evaluate model outputs at scale.
• Safety & Bias Auditing: Lead "Red Teaming" sessions to identify potential biases, toxic content, or PII (Personally Identifiable Information) leaks.
• Regression Testing: Manage the evaluation of model performance across different versions to ensure seamless upgrades and stability.
• Collaboration & Delivery: Work with Product Owner, Developers, AI Engineers and UX Designers to deliver the Virtual Companion. Contribute to sprint planning, code reviews and documentation.

Requirements & Qualifications:

• Bachelor's degree or above, with 2-5 years in software development and relevant experience specifically within the AI/ML development landscape.
• AI/ML Literacy: A strong grasp of LLM fundamentals, including tokens, temperature, top-p, and context windows.
• Programming: Proficiency in Python.
• API Testing: Expertise in testing RESTful APIs and WebSocket connections for real-time AI interactions.

What's in it for you?

• You will be working at the intersection of Software Engineering, Data Science, and Ethics. You will play a pivotal role in defining what "quality" means for the next generation of Virtual Companions, helping us build AI that users can trust and enjoy.
• Impact: Directly shape a product that will be used by global supply chain leaders.
• Innovation: Work at the intersection of Generative AI, agentic systems, and real world optimization.
• Culture: Collaborative, ethically driven, and inclusive environment.
• Growth: Dedicated learning budget, hands on exposure to real world supply chain challenges, clear career pathways

Inclusion statement

As a game-changer in sustainable technology and innovation, Dassault Systèmes is striving to build more inclusive and diverse teams across the globe. We believe that our people are our number one asset and we want all employees to feel empowered to bring their whole selves to work every day. It is our goal that our people feel a sense of pride and a passion for belonging. As a company leading change, its responsibility to foster opportunities for all people to participate in a harmonized Workforce of the Future.