Senior Data Engineer - On-Prem Lakehouse & Pipelines

SCIENTE INTERNATIONAL PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

SCIENTE INTERNATIONAL PTE. LTD. is seeking a senior data engineer to design, build, and maintain production-grade data pipelines and lakehouse solutions in an on-premises environment.

You will drive data platform initiatives, performance, security, and technical best practices. The role involves designing ETL/ELT pipelines with PySpark, building multi-layer lakehouse architectures, and deploying scalable pipelines using Kubernetes/Docker on premises.

Qualifications

• 8+ years of IT experience with 5+ years in data engineering/data pipelines.
• Expert SQL/SQL Server – query optimization, indexing & performance tuning.
• Advanced Python & PySpark.
• Apache Spark and distributed data processing.
• Kubernetes & Docker for on-premises deployments.
• Data modelling – relational & NoSQL; hands-on MongoDB/Cassandra.
• Lakehouse/Data Lake architecture, including Iceberg, partitioning & metadata.
• ETL/ELT orchestration – Apache Airflow or similar.
• CI/CD, Git, automated testing & IaC.
• Data security, governance, RBAC, masking & compliance.

Responsibilities

• Design and develop production-grade ETL/ELT pipelines using Python/PySpark.
• Build and manage multi-layer lakehouse architecture across raw, curated, and consumption layers.
• Deploy scalable data pipelines using Kubernetes/Docker in on-premise environments.
• Develop data models and optimize complex SQL Server queries and performance.
• Establish CI/CD, automated testing, monitoring, and version-control practices.
• Implement data security, governance, and access controls; mentor engineers and drive best practices.
• Collaborate with data scientists, BAs, and stakeholders to deliver business-ready datasets.
• Provide L3 support and lead resolution of complex data engineering challenges.

Skills

SQL/SQL Server

Python

PySpark

Apache Spark

Kubernetes

Docker

Data modelling

ETL/ELT

CI/CD

Data security

Tools

MongoDB

Cassandra

Job description

SCIENTE INTERNATIONAL PTE. LTD. is seeking a senior data engineer to design, build, and maintain production-grade data pipelines and lakehouse solutions in an on-premises environment.

You will drive data platform initiatives, performance, security, and technical best practices. The role involves designing ETL/ELT pipelines with PySpark, building multi-layer lakehouse architectures, and deploying scalable pipelines using Kubernetes/Docker on premises.