Senior Data Engineer - On-Prem Lakehouse & Pipelines

Sciente International Pte Ltd

Singapore

On-site

SGD 120,000 - 200,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Sciente International Pte Ltd is seeking a Senior Data Engineer to join our Data & Analytics team in Singapore. You will design, build, and maintain robust on-premise data pipelines, architect flexible lakehouse solutions, and lead data infrastructure initiatives to enable data-driven decision-making across the organization.

The role requires deep expertise in SQL Server, NoSQL, Spark/PySpark, Python, and containerized pipelines using Kubernetes.

Qualifications

Bachelor's degree in CS/IT/Engineering or related field.
At least 5 years' hands-on data engineering and pipeline development.
Hands-on SQL Server expertise: querying, indexing, performance tuning.
Experience with NoSQL databases (MongoDB or Cassandra).
Proficient in Spark and PySpark for large-scale processing.
Strong Python skills for data pipelines and automation.
Containerized pipelines with Kubernetes in on-prem environments.
Data modeling knowledge for relational and non-relational schemas.
Experience with Airflow or similar orchestration tools.
Knowledge of data security, RBAC, masking, and compliance.

Responsibilities

Design and build autonomous, production-grade ETL/ELT pipelines using Python and PySpark.
Develop flexible lakehouse architectures across raw, curated, and consumption layers.
Deploy and manage pipelines with Kubernetes and Docker on-premise.
Leverage SQL Server expertise to optimize data models and queries.
Establish CI/CD practices for data pipelines with automated tests and versioning.
Enforce governance and RBAC across data layers and ensure auditability.
Mentor junior engineers and conduct code reviews.
Collaborate with Data Scientists and Analysts to deliver datasets.