Senior Big Data Platform Engineer - Secure, Scalable Infra

Centre for Strategic Infocomm Technologies (CSIT); Singapore; On-site; SGD 180,000 - 240,000; Full time

Job summary

Centre for Strategic Infocomm Technologies (CSIT) is seeking a Senior Big Data Platform Staff Engineer to design and manage a scalable Big Data infrastructure. The role focuses on building streaming and batch data pipelines, optimizing performance, and ensuring secure data governance across on-prem and cloud storage.

You will collaborate with data scientists and engineers to support AI/ML workloads, data warehouses, and multi-terabyte search workloads while leading engineering teams and shaping

Qualifications

• Background in Computer Science, Engineering, or related field.
• 8+ years experience in managing Big Data Platforms with Spark/NoSQL stacks.
• Experience building streaming/batch pipelines and data warehouses.
• Knowledge of S3/NFS/HDFS storage and secure data handling.
• Proficient scripting: Bash, Python, Scala, Java.

Responsibilities

• Design, implement and manage Big Data Infrastructure platform (Hadoop, Spark, NoSQL).
• Manage clusters, scheduling, resource allocation, and performance tuning.
• Design storage solutions (HDFS, S3, others) for Big Data workloads.
• Ensure security, governance, encryption, and access controls.
• Collaborate with engineers and data scientists to optimize performance.
• Plan capacity, forecasting, procurement, and deployment of hardware/software.

Skills

Big Data Platform

Streaming pipelines

Data architecture

leadership experience

Education

Bachelor's in CS/Engineering

Tools

Spark

Iceberg

Trino

NiFi

Kafka

Airflow

Kubernetes

Elastic Stack

HDFS

S3

Python

Scala

Java

Job description

Centre for Strategic Infocomm Technologies (CSIT) is seeking a Senior Big Data Platform Staff Engineer to design and manage a scalable Big Data infrastructure. The role focuses on building streaming and batch data pipelines, optimizing performance, and ensuring secure data governance across on-prem and cloud storage.

You will collaborate with data scientists and engineers to support AI/ML workloads, data warehouses, and multi-terabyte search workloads while leading engineering teams and shaping