Senior Data Platform Engineer (Ingest & Storage) – Immediate Hiring

PATHSOURCE CONSULTING PTE. LTD.

Singapore

On-site

SGD 120,000 - 180,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

PATHSOURCE CONSULTING PTE. LTD. is seeking a hands-on Senior Data Platform Engineer to build and operate large-scale ingestion and storage services in an on-premise or hybrid environment.

The role is contract with immediate hiring, based in Singapore, with possible client-site work and relocation as required. The role focuses on data ingestion, distributed storage and cloud-native infrastructure using Kafka, Ceph, Apache Iceberg, Docker and Kubernetes.

Qualifications

  • Hands-on data engineering and data-platform experience.
  • Production experience with Docker and Kubernetes mandatory.
  • Experience with Kafka or streaming platforms.
  • Experience with Ceph or distributed storage and Iceberg or lakehouse.

Responsibilities

  • Build and support batch and streaming data-ingestion solutions using Kafka or comparable technologies.
  • Deploy and operate data-platform workloads using Docker and Kubernetes.
  • Support distributed storage and lakehouse services, including Ceph or comparable technologies and Apache Iceberg.
  • Integrate platform components such as catalogues, ingestion frameworks and observability tools.
  • Monitor platform reliability, troubleshoot production issues and contribute to performance tuning and recovery.
  • Prepare technical documentation, operating procedures and deployment runbooks.

Skills

Data pipeline design
Distributed systems

Tools

Docker
Kubernetes
Kafka
Ceph
Apache Iceberg

Job description

The client is a Singapore-based data consultancy seeking a hands-on Senior Data Platform Engineer to build and operate large-scale data ingestion and storage services in an on-premise or hybrid environment.

This is a contract role available for immediate hiring. Candidates who can commence at short notice are encouraged to apply. There may be potential for extension or conversion to a permanent position, subject to business requirements and individual performance. The role is based in Singapore. The hiring company is currently located in MacPherson, and work at or travel to client sites may be required. Final work location and arrangements will be confirmed.

JOB DESCRIPTION

We are looking for an experienced Data Platform Engineer to help build and operate a modern data platform. This is a contract role suited to someone who enjoys working with large-scale data ingestion, distributed storage and cloud-native infrastructure.

The role involves technologies such as Kafka, Ceph, Apache Iceberg, Docker and Kubernetes. Experience with every listed tool is not expected, but candidates should have strong hands-on experience in the core areas and be comfortable working with related technologies.

Key Responsibilities
  • Build and support batch and streaming data-ingestion solutions using Kafka or comparable technologies.
  • Deploy and operate data-platform workloads using Docker and Kubernetes.
  • Support distributed storage and lakehouse services, including Ceph or comparable technologies and Apache Iceberg.
  • Integrate platform components such as catalogues, ingestion frameworks and observability tools.
  • Monitor platform reliability, troubleshoot production issues and contribute to performance tuning and recovery.
  • Prepare technical documentation, operating procedures and deployment runbooks.
Requirements
  • Relevant hands-on experience in data engineering, data platforms, infrastructure engineering or a closely related role.
  • Production experience with both Docker and Kubernetes is mandatory.
  • Practical experience with Kafka or another data-ingestion or streaming platform.
  • Experience with Ceph or another distributed-storage technology, and Apache Iceberg or a comparable lakehouse/data-lake environment.
  • Experience deploying or supporting platforms in on-premise or hybrid environments is preferred.
  • Able to explain the platform components you have personally built, deployed or supported.
  • Comfortable working on a contract basis and attending client locations when required.
Preferred Experience
  • Experience with Apache Polaris, dltHub, VictoriaMetrics or VictoriaLogs.
  • Experience supporting large-scale data environments, including terabyte- or petabyte-scale platforms.
  • Experience with Kubernetes Operators, Helm, CI/CD or infrastructure automation.

This position focuses on ingestion and storage infrastructure. It is not primarily a business-intelligence, dashboarding, visualisation or data-analyst role.

ADDITIONAL INFORMATION

This is a contract role available for immediate hiring. Candidates who can commence at short notice are encouraged to apply. There may be potential for extension or conversion to a permanent position, subject to business requirements and individual performance.

The role is based in Singapore. The hiring company is currently located in MacPherson, and work at or travel to client sites may be required. Final work location and arrangements will be confirmed.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer - Batch Ingestion and Data Reliability (Contract) - URGENT HIRING
Senior Data Engineer - Batch Ingestion and Data Reliability (Contract) - URGENT HIRING

PATHSOURCE CONSULTING PTE. LTD. • Singapore

On-site
SGD 112,000 - 167,000
Senior Data Engineer - Streaming and Data Platform (Contract) URGENT HIRING
Senior Data Engineer - Streaming and Data Platform (Contract) URGENT HIRING

PATHSOURCE CONSULTING PTE. LTD. • Singapore

On-site
SGD 90,000 - 130,000
Senior Python Software Engineer Platform Services - IMMEDIATE HIRING
Senior Python Software Engineer Platform Services - IMMEDIATE HIRING

PATHSOURCE CONSULTING PTE. LTD. • Singapore

On-site
SGD 120,000 - 180,000
Senior Data Platform Engineer - Ingest & Storage (On-Prem)
Senior Data Platform Engineer - Ingest & Storage (On-Prem)

PATHSOURCE CONSULTING PTE. LTD. • Singapore

On-site
SGD 120,000 - 180,000
Senior Software Engineer - Platform Services (Contract) - IMMEDIATE HIRING
Senior Software Engineer - Platform Services (Contract) - IMMEDIATE HIRING

PATHSOURCE CONSULTING PTE. LTD. • Singapore

On-site
SGD 100,000 - 134,000
Senior Data Engineer
Senior Data Engineer

sciente international pte. ltd. • Singapore

On-site
SGD 140,000 - 210,000
Senior Data Engineer
Senior Data Engineer

hyperscal solutions pte. ltd. • Singapore

On-site
SGD 90,000 - 140,000
Senior Python Platform Engineer — Contract (Singapore)
Senior Python Platform Engineer — Contract (Singapore)

PATHSOURCE CONSULTING PTE. LTD. • Singapore

On-site
SGD 120,000 - 180,000
Data Engineer
Data Engineer

PageGroup Corporation Solutions (Malaysia) Sdn Bhd • Singapore

On-site
SGD 80,000 - 120,000
Big Data Operations Engineer
Big Data Operations Engineer

Tech Aalto Pte Ltd • Singapore

On-site
SGD 90,000 - 140,000