Senior Big Data Administrator

Epsilon; Bengaluru; On-site; INR 3,500,000 - 7,000,000; Full time

Job summary

Epsilon Bengaluru seeks an experienced DevOps engineer to design and manage CI/CD pipelines for microservices and data workloads. You will build cloud-native infrastructure, deploy applications with Docker and Kubernetes, and optimize Databricks environments for analytics workloads.

Join a team that prioritizes automation, monitoring, security, and cost efficiency across multi-cloud resources, with a focus on scalable, reliable deployments.

Qualifications

• 5+ years in DevOps with microservices, Unix/Linux, and scripting.
• Experience with CI/CD tools, containerization, orchestration, IaC, and monitoring.

Responsibilities

• Design and manage CI/CD pipelines for microservices and data workloads.
• Build cloud-native infra using Terraform, ARM, and CloudFormation.
• Deploy and orchestrate apps with Docker and Kubernetes.
• Manage Databricks environments for data engineering.
• Automate operations, monitoring, and alerting for HA systems.
• Collaborate with cross-functional teams to deliver pipelines.
• Ensure security, compliance, and cost optimization.
• Troubleshoot deployment and infra issues.

Skills

CI/CD tools

Azure DevOps

Jenkins

GitHub Actions

Docker

Kubernetes

Unix/Linux

Shell scripting

Python

Terraform

Education

B.S. in Computer Science or related field

Tools

Databricks

Terraform

ARM / CloudFormation

CloudWatch / Azure Monitor

Prometheus

Grafana

Docker

Kubernetes

Job description

Responsibilities

• Design, implement, and manage CI/CD pipelines for microservices and data workloads.


• Build and maintain cloud-native infrastructure (AWS/Azure/GCP) using Infrastructure as Code.


• Support deployment and orchestration of microservices-based applications (Docker, Kubernetes).


• Manage and optimize Databricks environments for data engineering and analytics workloads.


• Automate operational workflows, monitoring, and alerting for high availability systems.


• Collaborate with development, data engineering, and platform teams to ensure seamless delivery.


• Ensure security, compliance, and cost optimization across cloud resources.


• Troubleshoot deployment, performance, and infrastructure issues.

Requirements

• Requires 5+ years experience in DevOps and microservices, strong Unix/Linux and shell scripting skills, proficiency with CI/CD tools (Azure DevOps, Jenkins, GitHub Actions), containerization (Docker), orchestration (Kubernetes), Databricks, scripting (Python, Bash, PowerShell), Infrastructure as Code (Terraform, ARM, CloudFormation), and monitoring tools (Prometheus, Grafana, CloudWatch, Azure Monitor).


• Preferred experience with data engineering pipelines (Spark, Delta Lake), streaming architectures (Kafka, Event Hubs), data lake/lakehouse architectures, multi-region/high-availability setups, and cloud certifications.


• B.S. in Computer Science or related field required.