Production AI/LLM Engineer

NCS Group; Singapore; On-site; SGD 100,000 - 160,000; Full time

Job summary

NCS Group seeks an AI/LLM Specialist focused on prompt engineering, model integration, evaluation, and production quality within NCS AI Central’s Forward Deployed Engineering model.

This role helps take GenAI solutions from POC to production by building prompts, integrating foundation models via APIs, creating automated evaluation frameworks, and continuously monitoring accuracy, safety, hallucination, bias, drift, latency, and cost.

Qualifications

• 3+ years working hands-on with LLMs across prompt engineering, model integration, and evaluation.
• Proven experience designing and optimising prompts and prompt chains for production applications.
• Experience integrating models via APIs/gateways and evaluating methodologies.

Responsibilities

• Design, test, and optimise prompts and prompt chains for production use cases — balancing accuracy, latency, and cost.
• Integrate foundation models into applications via APIs and gateways; advise on model/version selection.
• Support light fine-tuning and instruction-tuning (LoRA/PEFT) where appropriate.
• Design and maintain evaluation harnesses and benchmark suites for LLMs and agents.
• Run comparative model benchmarking to inform model-selection decisions.
• Build automated regression suites linked to CI for production changes.

Skills

Prompt engineering

Model integration

Evaluation methodologies

Python scripting

CI/CD pipelines

Tools

RAGAS

DeepEval

TruLens

promptfoo

Hugging Face Transformers

Job description

NCS Group seeks an AI/LLM Specialist focused on prompt engineering, model integration, evaluation, and production quality within NCS AI Central’s Forward Deployed Engineering model.

This role helps take GenAI solutions from POC to production by building prompts, integrating foundation models via APIs, creating automated evaluation frameworks, and continuously monitoring accuracy, safety, hallucination, bias, drift, latency, and cost.