LLM & AI Quality Engineer: Testing & Safety Lead

NCS Group

Singapore

On-site

SGD 65,000 - 85,000

Full time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Strong professional development support

Job summary

A technology services firm in Singapore is seeking an experienced LLM / AI Quality Engineer to lead evaluations of AI applications and ensure they meet standards. This role involves defining evaluation strategies, conducting human reviews, and managing test activities to schedule. The ideal candidate should have strong testing methodologies, API & performance testing experience, and familiarity with programming, especially Python or TypeScript. Competitive compensation and professional development opportunities are offered.

Qualifications

  • 3+ years in software testing/QA with strong test methodology and tooling.
  • Familiarity with cloud services (AWS/Azure/GCP) and microservices.
  • Experience with model validation and monitoring in production.

Responsibilities

  • Lead the evaluation of AI applications and ensure quality.
  • Define evaluation strategies and establish human review rubrics.
  • Analyze requirements and manage test activities to schedule.

Skills

Test methodology
API testing
Performance testing
Programming (Python/TypeScript)

Education

Degree/Diploma in CS/IT or equivalent

Tools

Playwright
Postman
Selenium

Job description

A technology services firm in Singapore is seeking an experienced LLM / AI Quality Engineer to lead evaluations of AI applications and ensure they meet standards. This role involves defining evaluation strategies, conducting human reviews, and managing test activities to schedule. The ideal candidate should have strong testing methodologies, API & performance testing experience, and familiarity with programming, especially Python or TypeScript. Competitive compensation and professional development opportunities are offered.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Testing Lead - LLM Evaluation & Safety
AI Testing Lead - LLM Evaluation & Safety

NCS PTE. LTD. • Singapore

On-site
SGD 72,000 - 120,000
AI Safety Engineer — LLM Security & Governance
AI Safety Engineer — LLM Security & Governance

Nanyang Technological University • Singapore

On-site
SGD 120,000 - 180,000
AI Engineer – LLM, RAG & AI Ops Leader
AI Engineer – LLM, RAG & AI Ops Leader

Nomura Holdings, Inc. • Singapore

On-site
SGD 80,000 - 120,000
Senior Quality Engineer — AI & Automation Leader
Senior Quality Engineer — AI & Automation Leader

SimplifyNext • Singapore

On-site
SGD 90,000 - 130,000
ML Evaluation Engineer - Statistical QA for AI/LLMs
ML Evaluation Engineer - Statistical QA for AI/LLMs

Allegis Group Singapore Pte Ltd • Singapore

On-site
SGD 70,000 - 110,000
Production ML Engineer: LLMs & AI Workflows
Production ML Engineer: LLMs & AI Workflows

Viridien • Singapore

Hybrid
SGD 80,000 - 120,000
Senior AI Engineer & ML Ops Leader
Senior AI Engineer & ML Ops Leader

Temus • Singapore

On-site
SGD 100,000 - 140,000
AI Product Quality Engineer — Cloud & AI Systems
AI Product Quality Engineer — Cloud & AI Systems

Tencent • Singapore

On-site
SGD 60,000 - 80,000
Senior ML Engineer: LLMs, AI Pipelines & Production
Senior ML Engineer: LLMs, AI Pipelines & Production

Viridiengroup • Singapore

On-site
SGD 120,000 - 180,000
13-month annual base salary and performance bonus
Flexible hybrid work model
Comprehensive personal and family healthcare
+2
Senior AI Engineer — LLMs, Pipelines & AI Workflows
Senior AI Engineer — LLMs, Pipelines & AI Workflows

PERSONNEL LINK JOBHUB PTE. LTD. • Singapore

On-site
SGD 120,000 - 180,000