Data Engineer - AI Pipelines & Semantic Search

Centre for Strategic Infocomm Technologies (CSIT); Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Centre for Strategic Infocomm Technologies (CSIT) in Singapore is seeking Data Engineers to join a mission-critical team that processes hundreds of thousands of documents daily, building scalable pipelines and intelligent systems.

You will enable semantic search with vector embeddings, support multimedia data, and collaborate across product and data science teams to deliver high-quality data services for national security insights.

Qualifications

• Background in Computer Science or related field with hands-on data engineering experience.
• Experience building scalable ETL/ELT pipelines for large datasets.
• Ability to communicate complex technical concepts clearly.

Responsibilities

• Design and maintain high-throughput data pipelines for unstructured data.
• Develop transformations and embeddings for downstream retrieval.
• Build hybrid keyword and vector search indexing systems.
• Enable multimedia processing with computer vision models.
• Uphold data quality, testing, observability, and best practices.
• Collaborate with frontend, data science, and product teams.

Skills

Data engineering

ETL/ELT pipelines

Vector embeddings

Semantic search

Software development

Cloud-native

Education

Bachelors in CS or related field

Tools

Docker

Kubernetes

CI/CD pipelines

Vector databases

LLM integration

Job description

Centre for Strategic Infocomm Technologies (CSIT) in Singapore is seeking Data Engineers to join a mission-critical team that processes hundreds of thousands of documents daily, building scalable pipelines and intelligent systems.

You will enable semantic search with vector embeddings, support multimedia data, and collaborate across product and data science teams to deliver high-quality data services for national security insights.