Senior Data Platform Engineer - Ingest & Storage (On-Prem)

PATHSOURCE CONSULTING PTE. LTD.; Singapore; Presencial; SGD 120.000 - 180.000; Jornada completa

Descripción de la vacante

PATHSOURCE CONSULTING PTE. LTD. is seeking a hands-on Senior Data Platform Engineer to build and operate large-scale ingestion and storage services in an on-premise or hybrid environment.

The role is contract with immediate hiring, based in Singapore, with possible client-site work and relocation as required. The role focuses on data ingestion, distributed storage and cloud-native infrastructure using Kafka, Ceph, Apache Iceberg, Docker and Kubernetes.

Formación

• Hands-on data engineering and data-platform experience.
• Production experience with Docker and Kubernetes mandatory.
• Experience with Kafka or streaming platforms.
• Experience with Ceph or distributed storage and Iceberg or lakehouse.

Responsabilidades

• Build and support batch and streaming data-ingestion solutions using Kafka or comparable technologies.
• Deploy and operate data-platform workloads using Docker and Kubernetes.
• Support distributed storage and lakehouse services, including Ceph or comparable technologies and Apache Iceberg.
• Integrate platform components such as catalogues, ingestion frameworks and observability tools.
• Monitor platform reliability, troubleshoot production issues and contribute to performance tuning and recovery.
• Prepare technical documentation, operating procedures and deployment runbooks.

Conocimientos

Data pipeline design

Distributed systems

Herramientas

Docker

Kubernetes

Kafka

Ceph

Apache Iceberg

Descripción del empleo

PATHSOURCE CONSULTING PTE. LTD. is seeking a hands-on Senior Data Platform Engineer to build and operate large-scale ingestion and storage services in an on-premise or hybrid environment.

The role is contract with immediate hiring, based in Singapore, with possible client-site work and relocation as required. The role focuses on data ingestion, distributed storage and cloud-native infrastructure using Kafka, Ceph, Apache Iceberg, Docker and Kubernetes.