Senior Data Engineer — AI-Driven Data Lake Architect

TANGSPAC SEARCH PRIVATE LIMITED; Singapore; On-site; SGD 120,000 - 170,000; Full time

Job summary

TANGSPAC SEARCH PRIVATE LIMITED is seeking an experienced data engineering professional in Singapore to drive data platforms and lakehouse implementations. The role requires hands-on work with Spark, PySpark, SQL, Python and Scala across cloud platforms such as AWS, GCP and Azure, as well as data products, governance and AI-ready analytics.

The ideal candidate will design scalable data architectures, manage data ingestion, transformation and quality frameworks, and collaborate on end-to-end data

Qualifications

• 8-12 years of experience in Data Engineering, Big Data, Data Lake, or Lakehouse implementations.
• Hands-on experience with Databricks, Snowflake, Cloudera, Azure, AWS, GCP, Huawei, or Alibaba data platforms.
• Hands-on experience in developing Data products and marketplaces
• Strong expertise in Spark, PySpark, SQL, Python and Scala.
• Strong programming skills (Java, Scala, Python, SQL)
• Experience with Iceberg, Hudi, Delta Lake and object storage platforms.
• Experience implementing data ingestion, transformation, reconciliation and data quality frameworks.
• Experience with Trino, Dremio, Hive, Impala, Kafka, Flink, Spark Streaming and Airflow.
• Strong hands-on experience with Kubernetes, OpenShift, Docker, CI/CD, MLflow and observability tools.
• Ability to design data architectures supporting NLP and AI-driven analytics, including ingestion, curation, and governance of unstructured data within Data Lake, Data warehouse platforms.
• Experience working with ML platforms such as CML, Spark MLlib, and Python ML libraries (scikit-learn, XGBoost), including model deployment.
• Develop full-stack applications and internal engineering tools using Python, shell scripting, and modern web frameworks (e.g., Flask, React).
• Knowledge of data modelling, metadata management, lineage and governance.
• Experience exposing data through APIs, event streams, dashboards and BI platforms.
• Knowledge of Teradata, Netezza, Greenplum or MPP migration programs is advantageous.
• Experience with Kubernetes, OpenShift, Terraform, Jenkins, Git and CI/CD pipelines.

Skills

Big Data

Spark

PySpark

SQL

Python

Scala

Java

Tools

Databricks

Snowflake

Cloudera

Azure

AWS

GCP

Huawei

Alibaba

Kubernetes

OpenShift

Docker

CI/CD

MLflow

Job description

TANGSPAC SEARCH PRIVATE LIMITED is seeking an experienced data engineering professional in Singapore to drive data platforms and lakehouse implementations. The role requires hands-on work with Spark, PySpark, SQL, Python and Scala across cloud platforms such as AWS, GCP and Azure, as well as data products, governance and AI-ready analytics.

The ideal candidate will design scalable data architectures, manage data ingestion, transformation and quality frameworks, and collaborate on end-to-end data