Senior Multimodal AI Engineer - Build Scalable LLM/VLMs

NCS; Singapore; On-site; SGD 180,000 - 240,000; Full time

Job summary

NCS Singapore seeks a Senior LLM / Multimodal AI Engineer to lead development of foundation models and multimodal systems. You will architect, train, evaluate, and deploy LLMs and VLMs handling billions of user-generated content and video data, driving measurable business impact.

You will scale data pipelines, drive synthetic data strategies, and optimize retrieval, RAG, and deployment in a production environment using cutting-edge tools.

Qualifications

• 4+ years of hands-on experience in machine learning system development with NLP, CV, LLMs, or Multimodal AI.
• Proven track record of independently driving end-to-end ML initiatives from research to production deployment.

Responsibilities

• Architect and scale automated data pipelines that integrate video frames, images, OCR, ASR, and text for VLM pre-training and fine-tuning.
• Drive LLM-assisted annotation workflows and synthetic data generation strategies to minimise manual labeling overhead.
• Engineer robust data quality frameworks ensuring representative, accurate, and complete training datasets.
• Reproduce and optimise foundation model series (e.g., LLaVA, Qwen-VL family) for production environments.
• Execute supervised fine-tuning (SFT) and post-training for domain-specific content ecosystems including gaming, movies, automotive, and commercial advertising.
• Implement advanced training techniques including PEFT, LoRA, and quantization-aware training.
• Design and deploy hierarchical Retrieval-Augmented Generation (RAG) pipelines that enrich video understanding and enable in-context retrieval.
• Build scalable vector search indexes (e.g., FAISS) supporting billions of embeddings.
• Optimise retrieval strategies including hybrid search, re-ranking, and query expansion.
• Inference optimization & deployment using vLLM, TensorRT-LLM, Triton, and ONNX Runtime.

Skills

ML system development

Multimodal AI

NLP & CV

End-to-end deployment

Tools

PyTorch

Hugging Face

DeepSpeed

PEFT

LlamaFactory

FAISS

TensorRT-LLM

Triton

Weights & Biases

MLflow

Spark

SQL

Linux

Git

Job description

NCS Singapore seeks a Senior LLM / Multimodal AI Engineer to lead development of foundation models and multimodal systems. You will architect, train, evaluate, and deploy LLMs and VLMs handling billions of user-generated content and video data, driving measurable business impact.

You will scale data pipelines, drive synthetic data strategies, and optimize retrieval, RAG, and deployment in a production environment using cutting-edge tools.