Senior Data Engineer

tenten partners pte. ltd.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

TENTEN Partners is seeking a Senior Data Engineer to design and operate scalable data pipelines on modern cloud data platforms. The role requires hands-on experience with streaming and batch processing, Databricks, Kafka, and GenAI capabilities.

You will own production data pipelines, contribute to data ingestion and transformations, and lead knowledge-base initiatives with RAG solutions across business domains. Singapore-based opportunities on APAC scope.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related discipline.
• 5 years of experience in data engineering, data platform engineering, or cloud-scale analytics.
• Proven experience owning and operating production data pipelines and platform components.
• Hands-on experience designing, building, optimising, and supporting batch and/or streaming pipelines with orchestration, observability, and production support.

Responsibilities

• Design, build, optimise, and operate scalable batch and streaming data pipelines using Databricks, Apache Kafka, Microsoft Fabric, and Delta Lake.
• Develop ingestion, transformation, and serving capabilities across source systems (files, APIs, databases, streaming platforms).
• Use Python, SQL, and PySpark to transform, cleanse, validate, and prepare data for downstream consumption.
• Lead the implementation and operationalisation of knowledge bases and RAG solutions supporting GenAI and agentic AI use cases across business domains.
• Build and maintain knowledge bases across hosting platforms, including storage, lifecycle management, embedding, and vectorisation.

Skills

Streaming technologies

GenAI concepts

Education

Bachelor’s degree in Computer Science, Engineering, or related discipline

Tools

Databricks

Apache Kafka

Microsoft Fabric

Delta Lake

Python

SQL

PySpark

Retrieval-Augmented Generation (RAG)

Job description

We are partnering with a leading organisation to hire a Senior Data Engineer This is an exciting opportunity for a hands‑on engineer with strong experience in cloud data platforms, data engineering, streaming technologies, and Generative AI.

Key responsibilities include but are not limited to:

• Design, build, optimise, and operate scalable batch and streaming data pipelines using technologies such as Databricks, Apache Kafka, Microsoft Fabric, and Delta Lake.

• Develop robust data ingestion, transformation, and serving capabilities across diverse source systems, including files, APIs, databases, and streaming platforms.

• Use Python, SQL, and PySpark to transform, cleanse, validate, and prepare data for downstream consumption.

• Lead the implementation and operationalisation of knowledge bases and Retrieval-Augmented Generation (RAG) solutions supporting GenAI and agentic AI use cases across business domains.

• Build and maintain knowledge bases across a range of hosting platforms, including storage, lifecycle management, embedding, and vectorisation capabilities.

To qualify for this Senior Data Engineer role, you should have:

• A Bachelor’s degree in Computer Science, Engineering, or a related discipline.

• 5 yrearss of experience in data engineering, data platform engineering, or cloud‑scale analytics solution delivery.

• Demonstrated experience owning and operating production data pipelines and platform components.

• Strong hands‑on experience designing, building, optimising, and supporting batch and/or streaming pipelines, including orchestration, observability, error handling, performance tuning, and production support.

Equal Opportunity Statement

TENTEN Partners is an equal opportunity firm and is committed to providing equal employment opportunities to all qualified individuals without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or any other protected characteristic as outlined by applicable laws.