Data Engineer: AI-Driven Pipelines & Semantic Search

Centre for Strategic Infocomm Technologies; Singapore; On-site; SGD 90,000 - 140,000; Full time

Job summary

Centre for Strategic Infocomm Technologies is seeking Data Engineers to design and operate high-throughput data pipelines that ingest vast unstructured data, generate vector embeddings, and support semantic search for national security analytics in Singapore.

You will work on hybrid retrieval systems, multimedia processing, and collaboration with cross-functional teams to ensure data quality and scalable operations in mission-critical environments.

Qualifications

• Background in Computer Science or related field, with hands-on data engineering or software development experience.
• Experience building scalable ETL/ELT pipelines to process large datasets.
• Strong data quality and pipeline reliability understanding.

Responsibilities

• Architect, design, and maintain reliable, high-throughput pipelines ingesting unstructured data.
• Integrate AI models for data classification and information extraction.
• Develop transformation logic and generate vector embeddings for retrieval.
• Build and support hybrid indexing systems for keyword and vector search.
• Engineer scalable multimedia processing for video and image metadata.
• Collaborate with frontend, data science, and product teams to deliver data services.

Skills

Data engineering

ETL/ELT pipelines

High-throughput data pipelines

Data quality

Communication of technical concepts

Cloud-native environments

Container-based environments

AI model integration

Education

Bachelor's in Computer Science or related field

Tools

Docker

Kubernetes

Vector databases

LLM integration tools

Job description

Centre for Strategic Infocomm Technologies is seeking Data Engineers to design and operate high-throughput data pipelines that ingest vast unstructured data, generate vector embeddings, and support semantic search for national security analytics in Singapore.

You will work on hybrid retrieval systems, multimedia processing, and collaboration with cross-functional teams to ensure data quality and scalable operations in mission-critical environments.