GenAI LLM Engineer: Prompting & Production Readiness

NCS; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

NCS seeks an AI/LLM Engineer to drive prompt engineering, model integration, and evaluation from POC to production. You will build prompts, connect foundation models via APIs, and create automated assessment and benchmark suites to ensure safety, cost efficiency, and reliability.

You will collaborate with AI Architects, Solution Architects, and Testers to deliver evidence-based recommendations and reusable assets for scalable deployments.

Qualifications

• The ideal candidate has hands-on experience with LLMs across prompts, integration, and evaluation.
• Experience designing production prompts and integrating models via APIs/gateways.
• Strong evaluation methods including accuracy, hallucination, and toxicity metrics.

Responsibilities

• Design, test, and optimize prompts and prompt chains for production use cases.
• Integrate foundation models into applications via APIs and gateways with model/version guidance.
• Develop evaluation harnesses and benchmarking for model quality, safety, and cost.
• Build automated regression suites and CI-driven validation for changes.
• Conduct adversarial testing, detect bias, drift, and ensure governance readiness.

Skills

LLMs

Prompt engineering

Model integration

Evaluation

Python

CI pipelines

Education

Bachelor's degree in CS or related

Tools

Hugging Face Transformers

RAGAS

TruLens

promptfoo

DeepEval

Job description

NCS seeks an AI/LLM Engineer to drive prompt engineering, model integration, and evaluation from POC to production. You will build prompts, connect foundation models via APIs, and create automated assessment and benchmark suites to ensure safety, cost efficiency, and reliability.

You will collaborate with AI Architects, Solution Architects, and Testers to deliver evidence-based recommendations and reusable assets for scalable deployments.