Senior Data Platform Engineer (Contract) - On-Prem/K8s

PATHSOURCE CONSULTING PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

The client PATHSOURCE CONSULTING PTE. LTD. in Singapore seeks a hands-on Senior Infrastructure Engineer to deploy and operate the compute and transformation layer of a large-scale data platform on-premise or hybrid.

This initial contract role may extend or convert based on business needs and performance. You will design, deploy, and operate distributed compute and transformation services, containerise with Docker, and run workloads on Kubernetes, Spark, Trino and ClickHouse.

Qualifications

• Minimum six years of hands-on experience in data-platform, big-data infrastructure, distributed systems or a closely related role.

Responsibilities

• Design, deploy and operate distributed compute, query and transformation services in an on-premise or hybrid environment.
• Containerise platform components using Docker and deploy and operate production workloads on Kubernetes.
• Build and support large-scale processing and query services using Spark, Trino and ClickHouse.
• Develop and maintain governed transformation workflows using dbt.
• Integrate compute services with Apache Iceberg tables and Apache Polaris catalogues.
• Tune workload performance, resource allocation, concurrency and reliability for terabyte- or petabyte-scale data.
• Implement monitoring and logging using VictoriaMetrics and VictoriaLogs or comparable observability tools.
• Troubleshoot distributed-system, workload, storage-integration and production-performance issues.
• Produce technical documentation, operating procedures and deployment runbooks.
• Work directly with technical stakeholders and contribute as a senior individual contributor.

Skills

Data-platform infra

Docker

Kubernetes

Spark

Trino

ClickHouse

dbt

Linux

Networking

High availability

On-premise

Tools

Docker

Kubernetes

Spark

Trino

ClickHouse

dbt

Apache Iceberg

Apache Polaris

VictoriaMetrics

VictoriaLogs

Ceph

Job description

The client PATHSOURCE CONSULTING PTE. LTD. in Singapore seeks a hands-on Senior Infrastructure Engineer to deploy and operate the compute and transformation layer of a large-scale data platform on-premise or hybrid.

This initial contract role may extend or convert based on business needs and performance. You will design, deploy, and operate distributed compute and transformation services, containerise with Docker, and run workloads on Kubernetes, Spark, Trino and ClickHouse.