Senior GenAI QA & Solution Analyst

NTT SINGAPORE PTE. LTD.; Singapore; On-site; SGD 180,000 - 240,000; Full time

Job summary

NTT Singapore Pte. Ltd. seeks a Senior GenAI Quality Engineer and Solution Analyst to analyse, test and validate enterprise Generative AI apps in a regulated financial environment.

This role blends UI/API automation with hands-on testing of production LLM, RAG and agentic systems, translating ambiguous business needs into clear solution flows and acceptance criteria. You will define end-to-end, risk-based test strategies, validate prompts, data handling, and compliance, and produce traceable

Qualifications

• 4+ years of hands-on software quality engineering or SDET experience.
• Recent experience testing enterprise GenAI, LLM, RAG or agentic applications.
• Strong UI and REST API automation experience.
• Hands-on experience with Playwright, Cypress or Selenium.
• Hands-on API automation with Postman, REST Assured, PyTest or equivalent.
• Proficiency in Python, Java, JavaScript or TypeScript.

Responsibilities

• Define end-to-end, risk-based test strategies for UI, REST APIs, back-end services and GenAI components.
• Validate LLM/RAG responses for accuracy, grounding, relevance, and safety.
• Create evaluation datasets, golden test sets and threshold-based acceptance.
• Test conversational and agentic behavior including multi-turn context and tool usage.
• Ensure robust CI/CD integration of automation and provide release evidence.

Skills

GenAI testing

UI automation

REST API automation

Python

Java

JavaScript

TypeScript

Playwright

Cypress

Selenium

PyTest

Git & CI/CD

Tools

Postman

REST Assured

Job description

NTT Singapore Pte. Ltd. seeks a Senior GenAI Quality Engineer and Solution Analyst to analyse, test and validate enterprise Generative AI apps in a regulated financial environment.

This role blends UI/API automation with hands-on testing of production LLM, RAG and agentic systems, translating ambiguous business needs into clear solution flows and acceptance criteria. You will define end-to-end, risk-based test strategies, validate prompts, data handling, and compliance, and produce traceable