Senior Data Platform Engineer — Cloud, On-Prem & Kubernetes

Tookitaki; Manila; On-site; PHP 1,800,000 - 2,400,000; Full time

Job summary

Tookitaki seeks a battle-tested Data Platform Engineer to build, operate, and evolve large-scale data platforms across Cloudera on-premises and cloud environments, plus AWS/Kubernetes architectures. You will work where distributed compute, storage, and production pipelines meet, tracing workloads from application to Spark or Flink.

Ideal candidates have strong Cloudera production experience, Hadoop/Hive expertise, and solid automation skills with Python, Bash, Terraform, and Ansible.

Qualifications

• Extensive hands-on experience administering Cloudera platforms in production.
• Experience with on-premises Cloudera and cloud-based Cloudera deployments.
• Deep knowledge of Hadoop, HDFS, Hive, YARN, Spark, and the wider distributed-data ecosystem.
• Experience building or operating production workloads using Apache Flink.
• Strong understanding of distributed data processing, including partitioning, shuffling, serialization, checkpointing, and failure recovery.
• Experience transforming large datasets using joins, aggregations, filtering, sorting, and schema evolution.
• Proficiency with Parquet, Avro, JSON, CSV, compression formats, and serialization tradeoffs.
• Experience designing data layouts for query performance, ingestion throughput, retention, and cost.
• Strong AWS experience with EMR, S3, EC2, EKS, IAM, CloudWatch, and KMS.
• Strong Kubernetes experience with operators, controllers, Helm, scheduling, storage, networking, and troubleshooting.
• Experience migrating data platforms from on-premises or VM-based environments into AWS and Kubernetes.
• Ability to troubleshoot Linux, JVM, networking, storage, DNS, certificates, and resource-management issues.
• Experience with observability platforms and correlating infrastructure symptoms with data-pipeline failures.
• Ability to automate operational work using Python, Bash, Terraform, Ansible, or equivalent tools.
• Strong judgment around production changes, data integrity, access control, rollback, and recovery.

Responsibilities

• Build and operate production data platforms across Cloudera on premises, Cloudera cloud environments, AWS EMR, and Kubernetes.
• Design batch and streaming pipelines using Spark, Flink, Hive, and related technologies.
• Transform large datasets through filtering, sorting, joining, aggregation, partitioning, enrichment, and restructuring.
• Work with Parquet, Avro, JSON, CSV, and other delimited or semi-structured formats.
• Design storage, partitioning, compression, retention, and lifecycle strategies across HDFS, Hive, and object storage.
• Design and maintain Hive schemas, tables, partitions, metadata, and data models.
• Administer Cloudera clusters, including installation, upgrades, configuration, scaling, patching, security, backup, and recovery.
• Troubleshoot unhealthy services, failed jobs, resource contention, data skew, small-file problems, metadata issues, and storage bottlenecks.
• Tune Spark and Flink workloads for memory, CPU, parallelism, shuffle behavior, checkpointing, and recovery.
• Operate AWS services such as EMR, S3, IAM, EC2, EKS, CloudWatch, KMS, and supporting networking services.
• Deploy and operate data workloads on Kubernetes using operators, Helm, custom resources, and GitOps-based delivery.
• Help migrate workloads from physical or virtual machines and EC2 into AWS and Kubernetes-based platforms.
• Separate compute from storage where appropriate while accounting for performance, resilience, security, and cost.
• Build monitoring, alerting, capacity management, and operational runbooks for critical data services.
• Automate platform provisioning and configuration using Terraform, Ansible, scripting, and CI/CD.
• Support production incidents involving failed pipelines, delayed data, cluster degradation, storage pressure, or infrastructure failure.
• Work with data engineering, infrastructure, security, and application teams to resolve problems across ownership boundaries.

Skills

Python

Bash

Terraform

Ansible

Spark

Flink

Hive

HDFS

Kubernetes

AWS

Cloudera

Linux

Observability

Data pipelines

Tools

Cloudera

Kubernetes

Spark

Flink

Hive

HDFS

AWS EMR

Terraform

Ansible

Job description

Tookitaki seeks a battle-tested Data Platform Engineer to build, operate, and evolve large-scale data platforms across Cloudera on-premises and cloud environments, plus AWS/Kubernetes architectures. You will work where distributed compute, storage, and production pipelines meet, tracing workloads from application to Spark or Flink.

Ideal candidates have strong Cloudera production experience, Hadoop/Hive expertise, and solid automation skills with Python, Bash, Terraform, and Ansible.