Senior AI Agent Assurance Engineer

Temasek; Singapore; On-site; SGD 140,000 - 210,000; Full time

Job summary

Temasek is seeking an Agent Harness / Assurance Specialist to design and operate systems that verify, validate, and continuously monitor the behaviour of Temasek’s AI agents in production investment workflows.

This role combines context engineering, AI evaluation, and operational assurance to constrain agent behaviour, detect drift, and enforce structured outputs and governance across multi-turn interactions.

Qualifications

• Experience evaluating, testing, or governing LLM or agentic AI systems.
• Demonstrated expertise in at least two: LLM evaluation, prompt engineering, AI red-teaming, or AI monitoring.
• Experience with production AI systems in regulated environments is preferred.

Responsibilities

• Design and operate evaluation frameworks for deployed agents.
• Build and maintain evaluation datasets and rubrics.
• Run red-team evaluations to test boundary conditions and prompt injection vulnerabilities.
• Define evaluation gates in the deployment pipeline and automate regression testing.
• Collaborate with AI product teams to turn evaluation insights into production improvements.

Skills

AI safety

LLM evaluation

Adversarial testing

Governance

Python

Pandas

NumPy

Claude API

OpenAI API

LangChain

LangGraph

AutoGen

LangSmith

RAGAS

DeepEval

LangFuse

Helicone

Weights & Biases

Tools

Claude API

OpenAI API

LangChain

LangGraph

AutoGen

LangSmith Evals

RAGAS

DeepEval

LangFuse

Helicone

Weights & Biases

Python

Pandas

NumPy

Job description

Temasek is seeking an Agent Harness / Assurance Specialist to design and operate systems that verify, validate, and continuously monitor the behaviour of Temasek’s AI agents in production investment workflows.

This role combines context engineering, AI evaluation, and operational assurance to constrain agent behaviour, detect drift, and enforce structured outputs and governance across multi-turn interactions.