AI Evaluation & Validation Engineer

Nanyang Technological University; Singapore; On-site; SGD 70,000 - 100,000; Full time

Job summary

NTU's National Centre for Research in Digital Trust (DTC) is hiring a Research Engineer to evaluate AI systems, build test datasets, and develop prototypes. You will work with external partners, design evaluation frameworks and provide actionable recommendations to improve trustworthiness and safety of AI in real-world conditions.

The role focuses on practical assessment, error analysis, and communicating results to diverse audiences while contributing to a national program to position Singapore

Qualifications

• Bachelor's degree or equivalent in CS/engineering/data science.
• Strong Python and ML workflow experience.
• Familiarity with NLP and large language models.
• Experience in evaluation methodology or data annotation is a plus.
• Ability to work independently under tight timelines.

Responsibilities

• Design evaluation frameworks, datasets and scoring methods for AI/ML systems.
• Develop annotation guidelines and monitor labelling quality.
• Conduct error analysis and translate findings into improvement recommendations.
• Run experiments with large language models and build tooling.
• Communicate results clearly to technical and non-technical audiences.

Skills

Python

ML workflows

NLP

Communication

Independent work

Data analysis

Education

Bachelor's degree in computer science, engineering, data science

Job description

NTU's National Centre for Research in Digital Trust (DTC) is hiring a Research Engineer to evaluate AI systems, build test datasets, and develop prototypes. You will work with external partners, design evaluation frameworks and provide actionable recommendations to improve trustworthiness and safety of AI in real-world conditions.

The role focuses on practical assessment, error analysis, and communicating results to diverse audiences while contributing to a national program to position Singapore