Senior Data Engineer - GenAI, Streaming Data Pipelines

tenten partners pte. ltd.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

TENTEN Partners is seeking a Senior Data Engineer to design and operate scalable data pipelines on modern cloud data platforms. The role requires hands-on experience with streaming and batch processing, Databricks, Kafka, and GenAI capabilities.

You will own production data pipelines, contribute to data ingestion and transformations, and lead knowledge-base initiatives with RAG solutions across business domains. Singapore-based opportunities on APAC scope.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related discipline.
• 5 years of experience in data engineering, data platform engineering, or cloud-scale analytics.
• Proven experience owning and operating production data pipelines and platform components.
• Hands-on experience designing, building, optimising, and supporting batch and/or streaming pipelines with orchestration, observability, and production support.

Responsibilities

• Design, build, optimise, and operate scalable batch and streaming data pipelines using Databricks, Apache Kafka, Microsoft Fabric, and Delta Lake.
• Develop ingestion, transformation, and serving capabilities across source systems (files, APIs, databases, streaming platforms).
• Use Python, SQL, and PySpark to transform, cleanse, validate, and prepare data for downstream consumption.
• Lead the implementation and operationalisation of knowledge bases and RAG solutions supporting GenAI and agentic AI use cases across business domains.
• Build and maintain knowledge bases across hosting platforms, including storage, lifecycle management, embedding, and vectorisation.

Skills

Streaming technologies

GenAI concepts

Education

Bachelor’s degree in Computer Science, Engineering, or related discipline

Tools

Databricks

Apache Kafka

Microsoft Fabric

Delta Lake

Python

SQL

PySpark

Retrieval-Augmented Generation (RAG)

Job description

TENTEN Partners is seeking a Senior Data Engineer to design and operate scalable data pipelines on modern cloud data platforms. The role requires hands-on experience with streaming and batch processing, Databricks, Kafka, and GenAI capabilities.

You will own production data pipelines, contribute to data ingestion and transformations, and lead knowledge-base initiatives with RAG solutions across business domains. Singapore-based opportunities on APAC scope.