Data Platform Engineer

Capgemini; Singapore; On-site; SGD 80,000 - 120,000; Full time

Job summary

A global technology partner is looking for a Platform Engineer based in Singapore. The role focuses on designing, building, and supporting scalable cloud-native data platforms on Microsoft Azure. Candidates should have strong hands-on experience with Kubernetes, Docker, and various data platforms, as well as expertise in automation using Linux and Python. Strong problem-solving skills and the ability to work in cross-functional teams are essential. Competitive compensation and opportunities for career growth are available.

Qualifications

• Strong experience with cloud-native platforms on Microsoft Azure.
• Hands-on expertise in Linux, Python, and Shell scripting.
• Solid experience with Docker and Kubernetes (AKS preferred).
• Experience supporting Apache Spark workloads in production environments.
• Working knowledge of Iceberg, Trino, DataHub, and Ranger.
• Experience with Azure DevOps and CI/CD pipelines.
• Good understanding of platform security, identity, and secrets management.
• Experience with monitoring and observability tools.

Responsibilities

• Design, build, and maintain cloud-native data platforms.
• Automate infrastructure and operational tasks using Linux, Python, and Shell scripting.
• Build, manage, and optimize Docker images and containerized workloads.
• Deploy, operate, and troubleshoot workloads on Kubernetes (AKS or equivalent).
• Support and optimize Apache Spark and Apache Iceberg-based data platforms.
• Work with DataHub, Trino, and Apache Ranger for metadata, query, and governance use cases.
• Implement and maintain Azure CI/CD pipelines.
• Ensure secure platform access using TLS/SSL, OAuth, and HashiCorp Vault.
• Configure and manage Azure services including Blob Storage, Virtual Machines, VNETs, and AKS.
• Implement and manage NGINX Ingress Controllers and firewall rules.
• Monitor platforms using Prometheus and Grafana.
• Provide production support including troubleshooting, incident resolution, and performance tuning.
• Ensure adherence to enterprise change management and release processes.

Skills

Cloud-native platforms on Microsoft Azure

Linux

Python

Shell scripting

Docker

Kubernetes

Apache Spark

Iceberg

Trino

DataHub

Ranger

Azure DevOps

CI/CD pipelines

Monitoring tools

Job description

Role Summary

We are seeking a Platform Engineer to design, build, and support scalable, secure, cloud-native data platforms on Microsoft Azure. The role involves strong hands-on work with Kubernetes, data platforms, automation, and DevOps, along with exposure to modern AI-enabled ecosystems.

Key Responsibilities

• Design, build, and maintain cloud-native data platforms
• Automate infrastructure and operational tasks using Linux, Python, and Shell scripting
• Build, manage, and optimize Docker images and containerized workloads
• Deploy, operate, and troubleshoot workloads on Kubernetes (AKS or equivalent)
• Support and optimize Apache Spark and Apache Iceberg-based data platforms
• Work with DataHub, Trino, and Apache Ranger for metadata, query, and governance use cases
• Implement and maintain Azure CI/CD pipelines
• Ensure secure platform access using TLS/SSL, OAuth, and HashiCorp Vault
• Configure and manage Azure services including Blob Storage, Virtual Machines, VNETs, and AKS
• Implement and manage NGINX Ingress Controllers and firewall rules
• Monitor platforms using Prometheus and Grafana
• Provide production support including troubleshooting, incident resolution, and performance tuning
• Ensure adherence to enterprise change management and release processes

Required Skills And Experience

• Strong experience with cloud-native platforms on Microsoft Azure
• Hands-on expertise in Linux, Python, and Shell scripting
• Solid experience with Docker and Kubernetes (AKS preferred)
• Experience supporting Apache Spark workloads in production environments
• Working knowledge of Iceberg, Trino, DataHub, and Ranger
• Experience with Azure DevOps and CI/CD pipelines
• Good understanding of platform security, identity, and secrets management
• Experience with monitoring and observability tools

Preferred Skills

• Experience with Databricks
• Knowledge or experience in Generative AI (Gen AI) platforms
• Exposure to Agentic AI concepts and architectures
• Experience working in large enterprise or regulated environments

Soft Skills

• Strong problem-solving and troubleshooting abilities
• Ability to work effectively with cross-functional teams
• Good communication and documentation skills
• Ownership mindset with a focus on reliability and continuous improvement

Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of €22.1 billion.

Make it real | www.capgemini.com