Platform Engineer - Kubernetes & Data Platform

Torry Harris Business Solutions; Bengaluru; On-site; INR 4,000,000 - 5,600,000; Full time

Job summary

Torry Harris Business Solutions in Bengaluru is seeking a Platform Engineer to design, build, and operate an on-premises Kubernetes Data Platform powering large-scale data processing, AI/ML workloads, real-time analytics, and self-service data capabilities.

You will implement production-grade platforms with Kubernetes, Spark, Kafka, NiFi, and S3-compatible storage, focusing on security, multi-tenancy, and strong observability.

Qualifications

• Experience designing and operating production-grade on-prem Kubernetes platforms for data-intensive workloads.
• Hands-on with Stackable Data Platform, Apache Spark, Kafka, NiFi, and S3-compatible storage.
• Strong emphasis on GitOps, automation, and IaC for provisioning, deployment, and lifecycle management.

Responsibilities

• Design, build, and operate production-grade on-prem Kubernetes platforms for data-intensive and AI/ML workloads.
• Deploy and optimize Spark, Kafka, NiFi, and S3-compatible storage on Kubernetes.
• Implement automation with GitOps (Argo CD, Helm) and IaC across CI/CD pipelines.
• Establish monitoring, security, and governance practices for multi-tenant data platforms.
• Collaborate with Platform, Data Engineering, AI/ML, and Security teams on strategic data platform initiatives.

Skills

Kubernetes

Data engineering

CI/CD

GitOps

Argo CD

Apache Spark

Apache Kafka

Apache NiFi

S3-compatible storage

IaC

Security

Tools

Argo CD

Helm

Kubernetes

Job description

Are you a Platform Engineer passionate about Kubernetes and Data Engineering? Torry Harris is looking for a skilled Platform Engineer to join our team and help build a next-generation, on-premises Kubernetes Data Platform powering large-scale data processing, AI/ML workloads, real-time analytics, and self-service data capabilities.

As a Platform Engineer, you will design, build, automate, operate, and scale the platform using Kubernetes, Stackable Data Platform, Apache Spark, Apache Kafka, Apache NiFi, and S3-compatible Object Storage. You’ll work closely with Platform and Data Engineering teams to build a secure, resilient, scalable, and multi-tenant platform that enables strategic data initiatives.

Roles and Responsibilities

• Design, build, and operate **production-grade, on-premises Kubernetes platforms** for data-intensive and AI/ML workloads.
• Deploy, manage, and optimize **Stackable Data Platform, Apache Spark, Apache Kafka, Apache NiFi, and S3-compatible Object Storage** on Kubernetes.
• Build scalable, resilient, secure, and **multi-tenant platform architectures** with self-service capabilities for Data Engineering and AI/ML teams.
• Implement **GitOps and automation** using Argo CD, Helm, Infrastructure as Code, and CI/CD pipelines for platform provisioning, deployment, upgrades, and lifecycle management.
• Enable data lake, real-time analytics, AI/ML use cases, and migration of workloads from **legacy Hadoop to Kubernetes-native platforms**.
• Establish platform **monitoring, observability, alerting, capacity management, backup, and disaster recovery** practices.
• Troubleshoot complex production issues, lead **Root Cause Analysis (RCA)**, and drive continuous improvements in platform reliability and performance.
• Implement **Kubernetes security, RBAC, secrets, certificates, network policies, governance, and compliance** controls.
• Collaborate with Platform, Data Engineering, AI/ML, Infrastructure, and Security teams to deliver strategic **Data Platform initiatives** and engineering best practices.