Senior Data Engineer: AI-Ready Pipelines & RAG

NCS Group; Singapore; On-site; SGD 120,000 - 160,000; Full time

Job summary

NCS Group in Singapore is seeking a Senior Data Engineer to design AI-ready data pipelines for production-scale AI, ML and RAG systems. You will own ingestion, cleaning, transformation, data quality checks and governance to enable reliable AI outputs.

Collaborate with AI Engineers and Architects to align data architecture with model needs, implement vector store strategies (pgvector, Pinecone, OpenSearch) and ensure compliance across regulated domains.

Qualifications

• 5+ years in data engineering, delivering production-scale pipelines.
• Strong SQL and at least one systems language (Python/Scala/Java).
• Hands-on with batch and streaming frameworks (Airflow, Spark, Kafka).
• Experience building data pipelines for AI/ML or RAG use cases (embeddings, vector indexing).
• Solid data governance, PDPA-like patterns, and data residency awareness.

Responsibilities

• Design/build AI-ready ingestion, cleaning and transformation pipelines.
• Create batch/streaming pipelines (Airflow/Prefect/Kafka) ensuring reliable data flow.
• Own data quality, schema validation and completeness checks upstream of models/RAG.
• Architect RAG data ingestion/indexing pipelines and vector search infrastructure.

Skills

5+ years experience

SQL

Python/Scala/Java

Batch & streaming

AI/ML & RAG

Data governance

FDE/POC

Data architecture

Tools

Airflow

Spark

Kafka

pgvector

Pinecone

Weaviate

OpenSearch

Azure AI Search

Job description

NCS Group in Singapore is seeking a Senior Data Engineer to design AI-ready data pipelines for production-scale AI, ML and RAG systems. You will own ingestion, cleaning, transformation, data quality checks and governance to enable reliable AI outputs.

Collaborate with AI Engineers and Architects to align data architecture with model needs, implement vector store strategies (pgvector, Pinecone, OpenSearch) and ensure compliance across regulated domains.