Gen AI QA Engineer — LLM Testing & Reliability

SCIENTEC CONSULTING PTE. LTD.; Singapore; Hybrid; SGD 70,000 - 90,000; Full time

Job summary

A leading technology consulting firm in Singapore is seeking a skilled Gen AI Quality Engineer to test and validate Large Language Models (LLMs) integrated into applications. This role requires at least 4 years of QA experience, with a strong emphasis on detecting and resolving model inaccuracies. Collaborate with developers and AI researchers while maintaining thorough test documentation. The position offers a hybrid working arrangement and a competitive salary package.

Qualifications

• 4+ years of QA experience with LLM and Gen AI testing.
• Strong understanding of testing methodologies and best practices.

Responsibilities

• Design and execute test cases for LLM accuracy and performance.
• Detect and report hallucinations in model outputs.
• Implement automated tests for regression and edge cases.
• Collaborate with data scientists to resolve model issues.
• Maintain thorough test documentation.

Skills

Detail-oriented

Automated Testing

Functional Testing

Non-Functional Testing

Collaboration

Education

Bachelor’s degree in Computer Science or related field

Job description

A leading technology consulting firm in Singapore is seeking a skilled Gen AI Quality Engineer to test and validate Large Language Models (LLMs) integrated into applications. This role requires at least 4 years of QA experience, with a strong emphasis on detecting and resolving model inaccuracies. Collaborate with developers and AI researchers while maintaining thorough test documentation. The position offers a hybrid working arrangement and a competitive salary package.