AI Quality Scientist: LLM Validation & Data Quality

ALLEGIS GROUP SINGAPORE PRIVATE LIMITED; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Allegis Group Singapore Private Limited is seeking a Data Scientist to join a growing global technology team focused on AI quality operations. You will validate and improve outputs from LLM and ML models, building scalable data quality systems and dashboards to monitor performance.

The role interfaces with data engineering, product, and operations to ensure reliable datasets and workflows. The ideal candidate has strong statistics, Python (Pandas, NumPy, Scikit-learn), SQL, and experience

Qualifications

• Proven experience as a Data Scientist with strong foundations in statistics and data analysis.
• Hands-on experience working with or validating LLM / ML models in production environments.
• Strong proficiency in Python (e.g. Pandas, NumPy, Scikit-learn) and SQL.
• Experience applying statistical methods for validation, experimentation, or anomaly detection.
• Demonstrated ability to build tools, automation workflows, or data pipelines.
• Solid understanding of data quality, risk identification, and validation methodologies.

Responsibilities

• Audit and validate AI/LLM model outputs to ensure accuracy, consistency, and relevance.
• Design and implement data quality metrics, sampling strategies, and audit frameworks.
• Perform statistical analysis and anomaly detection to identify risks and improve output quality.
• Build and enhance automation tools, dashboards, and self-serve platforms for quality monitoring.
• Develop Python-based solutions to process, evaluate, and improve data reliability.
• Collaborate with data engineering, product, and operations teams to ensure high-quality datasets and workflows.
• Identify risks, propose action plans, and continuously improve quality control processes.
• Contribute to building scalable systems for large-scale AI validation and monitoring.

Skills

Data Science

Statistics

Python

SQL

ML/LLM validation

Tools

Pandas

NumPy

Scikit-learn

Tableau

Job description

Allegis Group Singapore Private Limited is seeking a Data Scientist to join a growing global technology team focused on AI quality operations. You will validate and improve outputs from LLM and ML models, building scalable data quality systems and dashboards to monitor performance.

The role interfaces with data engineering, product, and operations to ensure reliable datasets and workflows. The ideal candidate has strong statistics, Python (Pandas, NumPy, Scikit-learn), SQL, and experience