Senior AI Assurance Engineer - Agent Governance & Testing

Temasek International Pte. Ltd.; Singapore; On-site; SGD 120,000 - 210,000; Full time

Job summary

Temasek International Pte. Ltd. is expanding its AI governance team in Singapore to design and operate the agent harnesses that shape and constrain agent behaviour in production.

You will define behavioural specifications, manage context and tooling usage, and monitor system performance across multi-turn interactions. The role focuses on evaluating AI agents, building robust datasets, and conducting red-team testing to ensure safety and reliability in high-stakes deployments.

Qualifications

• 4-7 years of experience evaluating, testing, or governing LLM or agentic AI systems.
• Expertise in two or more: LLM evaluation frameworks, prompt engineering for production agents, AI red-teaming, or AI system monitoring.
• Experience with production AI systems in regulated/high-stakes environments preferred.
• Familiarity with AI safety and alignment research (RLHF, constitutional AI, interpretability) is advantageous.

Responsibilities

• Design and operate evaluation frameworks for deployed agents, including automated evaluation suites and scoring rubrics.
• Build and maintain evaluation datasets with ground-truth labels and metrics.
• Run red-team evaluations to test boundaries and prompt-injection vulnerabilities.
• Define and enforce evaluation gates in deployment pipelines and automate regression testing.
• Collaborate with AI product teams to design feedback mechanisms and feed insights into improvements.

Skills

Python proficiency

LLM evaluation

Adversarial testing

Observability

Tools

Anthropic Claude API

OpenAI API

LangChain

LangGraph

AutoGen

LangSmith Evals

LangFuse

Weights & Biases

Job description

Temasek International Pte. Ltd. is expanding its AI governance team in Singapore to design and operate the agent harnesses that shape and constrain agent behaviour in production.

You will define behavioural specifications, manage context and tooling usage, and monitor system performance across multi-turn interactions. The role focuses on evaluating AI agents, building robust datasets, and conducting red-team testing to ensure safety and reliability in high-stakes deployments.