DevOps Consultant

WAISL Limited; Bengaluru Urban; On-site; INR 3,800,000 - 5,000,000; Full time

Job summary

WAISL Limited is seeking a Senior DevOps Engineer to lead infrastructure and deployment for our data and AI platform. This role focuses on building resilient, scalable systems for on-premises and hybrid environments, supporting microservices, real-time streaming, and batch processing.

You will collaborate with architects to design, automate, and scale infrastructure for mission-critical applications involving Kafka, Spark, and distributed storage.

Qualifications

• 8+ years in DevOps and SRE roles.
• Hybrid/on-prem Kubernetes deployments experience.
• Proficiency in infrastructure automation (Terraform, Ansible, Helm).
• Experience with data processing and microservices orchestration in hybrid or on-prem environments.
• Strong understanding of networking, storage, firewalls, and security for hybrid deployments.
• Scripting in Bash, Python, or Go.
• Strong DevOps practices, observability, and reliability engineering.

Responsibilities

• Architect and maintain hybrid/on-prem environments for compute and storage.
• Deploy and manage containerized microservices with Kubernetes (on-prem and cloud).
• Automate infrastructure provisioning with Terraform and Ansible.
• Configure and scale Kafka, Spark, and data lake/warehouse platforms.
• Design for elastic scaling, load balancing, and resource isolation for data services and APIs.
• Secure hybrid deployments with VPNs, firewalls, and identity management; implement data access controls and encryption.
• Build and maintain CI/CD pipelines for zero-downtime deployments; support incident management and runbook creation.

Skills

Kubernetes

Terraform

Ansible

Helm

CI/CD

Python

Bash scripting

Go

Linux

Observability

Networking

Security

Education

CS/Engineering degree

Tools

Kubernetes

Terraform

Ansible

Helm

Prometheus

Grafana

OpenTelemetry

Job description

Experience: 8-10+ years

Type: Full-time

Role Overview

We are seeking a highly skilled Senior DevOps Engineer to lead infrastructure and deployment efforts for our next-generation data and AI platform. This role focuses on building resilient, scalable systems for on-premises and hybrid environments, supporting microservices, real-time data streaming, and batch processing.

You will work closely with architects and engineering teams to design, automate, and scale infrastructure for mission-critical applications involving Kafka, Spark, and distributed storage systems.

Key Responsibilities

Infrastructure Design & Automation

• Architect and maintain hybrid and on-premises environments for compute and storage workloads.
• Deploy and manage containerized microservices using Kubernetes (on-prem and cloud).
• Automate infrastructure provisioning using Terraform, Ansible, or similar tools.
• Configure and scale distributed data streaming and storage platforms (eg: Kafka clusters, Apache Spark, and data lake/warehouse).

Scalability & Performance

• Design for elastic scaling, load balancing, and resource isolation for data services and APIs.

Security & Governance

• Secure hybrid deployments with VPNs, firewalls, and identity management.
• Implement data access controls, audit trails, and encryption across services and storage layers.
• Manage secrets securely across environments.
• Set up observability stacks (Prometheus, Grafana, ELK, OpenTelemetry) for real-time insight.

CI/CD & Operations

• Build pipelines to deploy services, data jobs, and configuration changes to hybrid infra.
• Maintain and enhance CI/CD pipelines for zero-downtime deployments and rollbacks.
• Support SRE practices including incident management, post-mortems, and runbook creation.

Required Skills

• Bachelor's or Master's in Computer Science, Engineering, or related field.
• 8+ years in DevOps and SRE roles.
• Strong experience with hybrid and on-prem Kubernetes deployments.
• Proficiency in infrastructure automation (Terraform, Ansible, Helm).
• Experience with data processing and microservices orchestration, supporting real-time data platforms in hybrid or on-premises environments.
• Solid understanding of networking, storage, firewalls, and security for hybrid deployments.
• Programming/scripting experience with Bash, Python, or Go.
• Strong grasp of DevOps best practices, observability, and system reliability engineering.

Good to Have

• Experience with data lake/warehouse platforms (HDFS, S3-compatible storage, Redshift, Snowflake).
• Knowledge of event-driven architectures, ETL/ELT pipelines, and data mesh concepts.
• Exposure to machine learning operations (MLOps) or data science workflows.
• Certifications in Kubernetes, cloud platforms, or security are a plus.