Enterprise Data & AI Platform Engineer

OVERSEA-CHINESE BANKING CORPORATION LIMITED; Singapore; On-site; SGD 120,000 - 180,000; Full time

Benefits offered by this job

Cloudera Certifications

AWS Certifications

Job summary

OVERSEA-CHINESE BANKING CORPORATION LIMITED seeks a seasoned Data Platform Engineer to manage Cloudera CDP, Cloudera ML, Hadoop, and Spark across AWS and on‑prem environments. You will drive platform upgrades, security hardening, and automation while ensuring reliability and scalability for enterprise data and AI workloads.

You will collaborate with Data, AI/ML, Infrastructure, Security, and SRE teams to deliver robust data platforms, support Generative AI workloads, and optimize performance in

Qualifications

• Must have hands-on experience with Cloudera CDP, CML, Hadoop, and Spark in hybrid cloud setups.
• Experience with platform upgrades, security patching, vulnerability remediation, and hardening.
• Strong knowledge of OpenShift / Kubernetes administration and Linux systems.

Responsibilities

• Administer and support CDP, CML, Hadoop, and Spark environments across AWS and on-premises infra.
• Manage platform upgrades, security patches, vulnerability remediation, and certificates.
• Support containerized platforms on Kubernetes, OpenShift, and AWS EKS for high availability.
• Monitor and optimize Data, Analytics, AI/ML platforms including SageMaker/EMR/S3.
• Automate operations with Shell/Python and collaborate with cross-functional teams.

Skills

Cloudera CDP

Cloudera ML (CML)

Hadoop Ecosystem

Apache Spark

Hybrid Cloud Architecture

AWS Core Services

AI/ML Infrastructure

SageMaker/Bedrock/OpenSearch/Glue/Ath

Kubernetes/OpenShift

Linux/Unix Administration

Platform Monitoring & Tuning

Education

Bachelor's degree in Computer Science/IT

Certifications in CDP/CML

AWS Certification

Big Data Certifications (Spark/Hadoop)

Tools

Cloudera CDP

Cloudera Machine Learning

Hadoop Ecosystem

Apache Spark

Kubernetes/OpenShift

AWS Cloud (EC2/EKS/S3/IAM)

Terraform/Ansible

CI/CD (Jenkins/GitLab/GitHub Actions)

Job description

Technical Skills

Core Skills (Must Have)

• Cloudera Data Platform (CDP)
• Cloudera Machine Learning (CML)
• Hadoop Ecosystem (HDFS, YARN, Hive, Impala, Ozone) Apache Spark
• Hybrid Cloud Architecture (AWS & On-Premises)
• AWS Core Services (EC2, EKS, IAM, S3, VPC, CloudWatch)
• AI/ML Infrastructure Support (GPU, Containers, Kubernetes)
• AI/ML Services: SageMaker/Bedrock/OpenSearch/Glue/Athena/EMR

Preferred Skills

• Vulnerability Management, Security Patching, Hardening & Compliance Management
• Platform Upgrade, Migration & Maintenance Activities
• Microservices Architecture & REST APIs
• Certificate & Secrets Management
• OpenShift / Kubernetes Administration
• Hybrid Infrastructure Operations (AWS & On-Prem)
• MLOps Platforms and AI Model Lifecycle Management
• Linux / Unix Administration
• OpenShift / Kubernetes Administration
• Platform Monitoring, Troubleshooting & Performance Tuning

Good to Have

• Cloudera Certifications (CDP, CML, Cloudera Administrator)
• Big Data Certifications (Spark, Iceberg, Hadoop)
• AWS Certifications:
  • AWS Certified Solutions Architect
  • AWS Certified AI Practitioner
• Experience with CI/CD Tools (Jenkins, GitLab CI/CD, GitHub Actions, ArgoCD)
• Infrastructure as Code (Terraform, Ansible, CloudFormation)
• Experience with SRE Practices, Observability & Monitoring Platforms
• Exposure to Data Lakehouse Architectures and Apache Iceberg
• Experience supporting Generative AI platforms and LLM workloads
• Knowledge of Vector Databases, RAG Architectures and AI Governance
• DevSecOps and Cloud Security Best Practices
• Multi-Cloud or Hybrid Cloud Platform Management

Why Join

Join a team that powers OCBC's enterprise Data, Analytics, and AI platforms across hybrid cloud environments. You'll work with leading technologies including Cloudera CDP/CML, AWS Cloud, Big Data, and AI/ML platforms, while driving innovation, reliability, and operational excellence.

How You Succeed

Success in this role comes from your ability to manage and optimize complex hybrid cloud data platforms, automate operations, resolve issues proactively, and collaborate effectively with Data, AI/ML, Infrastructure, Security, and SRE teams.

What You Do

Administer and support Cloudera Data Platform (CDP), Cloudera Machine Learning (CML), Hadoop, and Spark environments across AWS and on-premises infrastructure.

Manage platform upgrades, security patching, vulnerability remediation, certificate management, and platform hardening activities.

Support containerized platforms on Kubernetes, OpenShift, and AWS EKS, ensuring high availability and performance.

Monitor, troubleshoot, and optimize Data, Analytics, AI/ML, and Generative AI platforms including AWS services such as SageMaker, Bedrock, EMR, and S3.

Automate operational processes using Shell/Python scripting and collaborate with Infrastructure, Security, and SRE teams to improve platform reliability and scalability.

Who You Are

A degree in Computer Science, Information Technology, or a related field

At least 3 years of experience in software development, preferably in a banking or financial services environment

Proficient in one or more programming languages, such as Java, Python, or C++

Experience with Agile development methodologies and version control systems such as Git

Strong problem-solving skills, with the ability to analyze complex technical issues and develop creative solutions

Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams

Diploma or Degree in Computer Science, Information Technology, Engineering, or a related discipline.

5-8 years of experience supporting enterprise Data, Analytics, or AI/ML platforms, with hands‑on expertise in Cloudera Data Platform (CDP), Cloudera Machine Learning (CML), Hadoop, and Apache Spark.

Strong experience in hybrid cloud environments, including AWS services (EC2, EKS, IAM, S3, CloudWatch) and on-premises infrastructure, with knowledge of Kubernetes/OpenShift and Linux administration.

Proven experience in platform operations, upgrade and maintenance activities, security patching, incident management, troubleshooting, and automation using Shell and/or Python scripting.