Big Data Platform Engineer

KERRY CONSULTING PTE. LTD.; Singapore; On-site; SGD 120,000 - 160,000; Full time

Job summary

Kerry Consulting Pte Ltd is seeking a Big Data Platform Engineer to operate and enhance its enterprise data platform in Singapore. The role focuses on reliability, scalability, and security across production environments, with emphasis on automation and IaC.

You will collaborate with data and platform teams to implement CI/CD pipelines, manage upgrades, capacity planning, and disaster recovery, ensuring optimal performance for analytics and AI workloads.

Qualifications

• 5 years of experience supporting enterprise data platforms or big data environments.
• DevOps experience is a prerequisite with automation, scripting, and CI/CD.
• Hands-on experience with Terraform and Ansible for IaC.
• Experience with Cloudera Data Platform (CDP) on-premises preferred.
• Familiarity with Hadoop ecosystem is advantageous.

Responsibilities

• Administer, maintain and improve the enterprise big data platform for reliability and performance.
• Automate platform provisioning, deployment, and configuration using scripting and IaC.
• Contribute to DevOps initiatives by building automated deployment pipelines.
• Support capacity planning, patch management, DR, and performance tuning.
• Ensure security, stability and scalability for AI workloads.

Skills

DevOps

Automation

Scripting

CI/CD

IaC

Tools

Terraform

Ansible

Cloudera Data Platform

Hadoop

Job description

About the job

This is a leading organization investing in a modern enterprise data platform to support business-critical analytics, AI, and data-driven decision-making. As part of the continued evolution of its data engineering capabilities, the organization is seeking to appoint a Big Data Platform Engineer to operate, automate, and enhance its enterprise big data platform.

This is an excellent opportunity to join a high-performing technology team responsible for ensuring the reliability, scalability, and operational excellence of mission-critical data infrastructure.

Responsibilities

You will be responsible for the administration, maintenance, and continuous improvement of the organization's enterprise big data platform, ensuring high availability, performance, and security across production environments. You will manage platform operations, monitor system health, troubleshoot complex technical issues, and implement best practices for platform reliability and resilience.

Working closely with data engineers, platform engineers, infrastructure teams, and architects, you will automate platform provisioning, deployment, configuration, and operational processes using scripting and Infrastructure as Code (IaC). You will contribute to DevOps initiatives by building automated deployment pipelines, improving operational efficiency, and reducing manual intervention across the platform lifecycle.

You will also support platform upgrades, capacity planning, patch management, disaster recovery, and performance tuning while ensuring the platform remains secure, stable, and scalable to support enterprise data and AI workloads.

Requirements

We are looking for a System Engineer with 5 years of experience supporting enterprise data platforms or big data environments. Strong DevOps experience is a prerequisite, with proven expertise in automation, scripting, CI/CD practices, and Infrastructure as Code using tools such as Terraform, Ansible, or similar technologies.

Hands-on experience managing enterprise big data platforms is essential. Candidates with experience administering Cloudera Data Platform (CDP) on-premises will be highly preferred. Experience with Hadoop ecosystem technologies is advantageous but not essential. You should enjoy solving complex infrastructure challenges and working collaboratively within an enterprise platform engineering environment. Hands-on technical consulting candidates can be considered.

To apply, please apply directly or submit your resume to Claudia at [e-mail]. We regret that only shortlisted candidates will be notified.

License No: 16S8060 / Registration No: R26161178