Senior Data Engineer - AI Pipelines & RAG Architect

Anchor Search Group Pte Ltd; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Anchor Search Group Pte Ltd is seeking a Senior Data Engineer to design and operate large-scale data pipelines for AI-ready datasets across FDE engagements and production environments.

You will own ingestion, cleaning, transformation, and governance while building batch and streaming pipelines that support RAG systems and vector stores at scale. Collaboration with AI Engineers is essential to define data readiness and metadata standards.

Qualifications

• 10+ years in data engineering with production-scale pipeline design.

Responsibilities

• Design and build ingestion, cleaning, and transformation pipelines to AI-ready datasets.
• Build batch and streaming pipelines (Airflow/Prefect/Kafka) for reliable data flow.
• Own data quality and governance for upstream model/RAG pipelines.
• Flag data gaps that could degrade model performance.
• Collaborate with AI Engineers to align data architecture with model needs.
• Mentor junior data engineers and contribute reusable ingestion/indexing patterns.

Skills

Strong SQL

Python/Scala/Java

Airflow/Spark/Kafka

AI/ML data pipelines

Data governance & PII handling

Production-scale pipelines

Data quality & validation

Tools

pgvector

Pinecone

Weaviate

OpenSearch

Presidio

Job description

Anchor Search Group Pte Ltd is seeking a Senior Data Engineer to design and operate large-scale data pipelines for AI-ready datasets across FDE engagements and production environments.

You will own ingestion, cleaning, transformation, and governance while building batch and streaming pipelines that support RAG systems and vector stores at scale. Collaboration with AI Engineers is essential to define data readiness and metadata standards.