Senior Data Engineer — Lakehouse & AI Data Platforms

SAKSOFT PTE LIMITED; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

SAKSOFT PTE LIMITED is seeking a Senior Data Engineer with 10+ years of experience to design and operate enterprise Lakehouse platforms and data products. You will build scalable batch and streaming pipelines, support RAG, vector search, GenAI and deploy data contracts and governance.

You will collaborate across teams to implement open table formats like Iceberg, Hudi, Delta Lake, manage metadata, and expose data via APIs and BI tools, while ensuring performance and security in a cloud-native

Qualifications

• Bachelor’s degree in Computer Science, Engineering or related discipline.
• 10+ years in data engineering, big data, data lake or lakehouse implementations.

Responsibilities

• Implement and operationalize enterprise Lakehouse platforms, data products, and data marketplace capabilities.
• Develop scalable batch, streaming, CDC, and API-based data ingestion pipelines.
• Develop scalable multimodal data ingestion pipelines including content extraction from various file formats, regex for specific field extraction, content extraction from embedded images, frame extraction from video files, transcript extraction from audio files, etc
• Build, test, and maintain foundation and business data products with agreed data contracts, SLAs, and data quality controls.
• Implement open table formats such as Iceberg, Hudi, and Delta Lake.
• Support RAG, vector search, GenAI and agentic data pipelines.
• Perform performance tuning, optimization, production support, and root cause analysis.
• Create technical documentation, deployment guides, and operational runbooks.
• Ensure compliance with engineering standards, DevSecOps controls, and software delivery practices.

Skills

Spark

PySpark

SQL

Python

Java

Scala

Data Modeling

Metadata Management

Governance

APIs

BI Dashboards

CI/CD

Kubernetes

OpenShift

Docker

Airflow

Kafka

Flink

Spark Streaming

MLflow

Terraform

Jenkins

Git

Scikit-learn

XGBoost

Education

Bachelor’s degree in Computer Science, Engineering or related discipline

Tools

Databricks

Snowflake

Cloudera

Azure

AWS

GCP

Huawei

Alibaba

Iceberg

Hudi

Delta Lake

Trino

Dremio

Hive

Impala

Kafka

Flink

Spark Streaming

Airflow

Kubernetes

OpenShift

Docker

CI/CD

MLflow

Terraform

Jenkins

Git

CML

Spark MLlib

scikit-learn

XGBoost

Job description

SAKSOFT PTE LIMITED is seeking a Senior Data Engineer with 10+ years of experience to design and operate enterprise Lakehouse platforms and data products. You will build scalable batch and streaming pipelines, support RAG, vector search, GenAI and deploy data contracts and governance.

You will collaborate across teams to implement open table formats like Iceberg, Hudi, Delta Lake, manage metadata, and expose data via APIs and BI tools, while ensuring performance and security in a cloud-native