Senior Data Engineer — AI-Ready Pipelines & RAG

Ncs; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

NCS is hiring a Senior Data Engineer in Singapore to design AI-ready data pipelines powering AI/ML and RAG systems. You will own ingestion, cleaning, transformation, and data quality, ensuring scalable batch and streaming processes for production-grade AI outputs.

You will architect RAG data flows, embeddings, and vector search with pgvector, Pinecone, Weaviate, or OpenSearch, while upholding data governance and PDPA-aligned controls.

Qualifications

• 5+ years in data engineering with production pipelines.
• Proficient in SQL and at least one language (Python/Scala/Java).
• Experience with batch and streaming frameworks (Airflow, Spark, Kafka).
• Experience building data pipelines for AI/ML or RAG use cases.

Responsibilities

• Design and build AI-ready data pipelines for ingestion, cleaning, and transformation.
• Develop batch and streaming pipelines (Airflow/Prefect/Kafka) for reliable data flow.
• Own data quality, schema validation, and metadata governance.
• Architect RAG data ingestion, embeddings, and vector search integration.
• Operate vector stores (pgvector/Pinecone/Weaviate/OpenSearch) at scale.
• Collaborate with AI Engineers/Architects and mentor junior engineers.

Skills

SQL

Python

Batch pipelines

Streaming pipelines

Airflow

Spark

Kafka

Tools

pgvector

Pinecone

Weaviate

OpenSearch

Azure AI Search

Presidio

Job description

NCS is hiring a Senior Data Engineer in Singapore to design AI-ready data pipelines powering AI/ML and RAG systems. You will own ingestion, cleaning, transformation, and data quality, ensuring scalable batch and streaming processes for production-grade AI outputs.

You will architect RAG data flows, embeddings, and vector search with pgvector, Pinecone, Weaviate, or OpenSearch, while upholding data governance and PDPA-aligned controls.