Gen AI Experimentation Engineer

NCS PTE. LTD.; Singapore; On-site; SGD 140,000 - 210,000; Full time

Job summary

NCS PTE. LTD. is seeking an experienced AI Engineer within the Forward Deployed Engineering model to design and run rapid Gen AI experiments, testing prompts, configurations, and retrieval strategies in POC/POV engagements.

You will collaborate with PMs, developers and SMEs to refine data, prompts and evaluation methods. The role requires 6+ years of hands-on experience, familiarity with cloud AI services and agentic orchestration frameworks, and the ability to deliver fast, evidence-based

Qualifications

• 6+ years of hands-on experience, ownership of experimentation strategy across engagements.
• Advises PMs on feasibility and trade-offs; communicates findings to clients.
• Understanding of Gen AI concepts (tokenization, embeddings, RAG, prompting).
• Familiar with major cloud AI services (AWS Bedrock, Vertex AI, Azure AI Foundry).
• Knowledge of China AI models (DeepSeek, Qwen, GLM) is a strong plus.
• Familiarity with agentic orchestration frameworks for multi-step workflows.

Responsibilities

• Understand business problem, POC objectives, evaluation metrics.
• Design experiments: model configurations, prompts, retrieval strategies.
• Analyse Gen AI outputs for quality, accuracy and alignment; identify failures.
• Prepare data samples and build simple data pipelines for experimentation.
• Collaborate with PMs, devs, SMEs; document results clearly.

Skills

Gen AI concepts

Python

Cloud AI

Experimentation strategy

RAG embeddings

Prompting

LLMOps

Model evaluation

China models

Agentic orchestration

Tools

AWS Bedrock

Vertex AI

Azure AI Foundry

LangGraph

Strands

Vector DBs

Job description

NCS PTE. LTD. is seeking an experienced AI Engineer within the Forward Deployed Engineering model to design and run rapid Gen AI experiments, testing prompts, configurations, and retrieval strategies in POC/POV engagements.

You will collaborate with PMs, developers and SMEs to refine data, prompts and evaluation methods. The role requires 6+ years of hands-on experience, familiarity with cloud AI services and agentic orchestration frameworks, and the ability to deliver fast, evidence-based