Devops Hadoop Engineer

Synechron; Bengaluru, Chennai District; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Synechron is seeking a highly skilled DevOps Hadoop Engineer to design, implement, and manage scalable infrastructure and big data platforms in Bengaluru. You will collaborate with data engineering, development, and operations teams to deliver secure, reliable, and high-performing enterprise solutions.

The role emphasizes CI/CD automation, container orchestration with Kubernetes/OpenShift, IaC with Terraform/Ansible, and deep experience with Hadoop, Spark, and Kafka to enable robust data

Qualifications

• Experience designing, implementing, and managing CI/CD pipelines with Jenkins or similar tools.
• Strong background in container orchestration and cloud-native platform management.
• Proficiency in IaC tooling (Terraform/Ansible) and automation.
• Hands-on experience with Hadoop ecosystem (Hadoop, Spark, Kafka).
• Knowledge of distributed data architectures, performance tuning, and monitoring.

Responsibilities

• Design, implement, and maintain CI/CD pipelines to streamline software delivery.
• Deploy and manage containerized apps with Kubernetes and OpenShift.
• Develop and maintain IaC solutions using Terraform, Ansible, or similar tools.
• Architect and support big data platforms using Hadoop, Spark, and Kafka.
• Design distributed data architectures for scalable data processing.
• Collaborate with Development, Operations, and Data Engineering teams to meet requirements.
• Implement monitoring, logging, and alerting for platform stability.
• Optimize system performance and reliability across infra and data platforms.
• Ensure security, governance, and regulatory compliance across stacks.
• Troubleshoot production issues and provide timely resolutions for incidents.

Skills

Jenkins

GitOps

CI/CD

Terraform

Ansible

Kubernetes

OpenShift

Docker

Hadoop

Spark

Kafka

Linux

Monitoring

Security Best Practices

Regulatory Compliance

Tools

Terraform

Ansible

Jenkins

Kubernetes

OpenShift

Job description

Job Summary

We are seeking a highly skilled DevOps Hadoop Engineer to design, implement, and manage scalable infrastructure and big data platforms. The ideal candidate will have strong expertise in DevOps practices, CI/CD automation, container orchestration, infrastructure automation, and distributed data technologies. This role requires close collaboration with development, operations, and data engineering teams to deliver secure, reliable, and high-performing enterprise solutions.

Key Responsibilities

• Design, implement, and maintain CI/CD pipelines using Jenkins, GitOps, and other DevOps tools to streamline software delivery.
• Deploy, configure, and manage containerized applications using Kubernetes and OpenShift.
• Develop and maintain Infrastructure as Code (IaC) solutions using Terraform, Ansible, or similar automation tools.
• Architect, implement, and support big data platforms utilizing Hadoop, Spark, and Kafka technologies.
• Design and manage distributed data architectures to ensure scalable, reliable, and efficient data processing.
• Collaborate with Development, Operations, and Data Engineering teams to understand business requirements and deliver robust solutions.
• Implement monitoring, logging, and alerting solutions to ensure platform stability and operational excellence.
• Optimize system performance, scalability, and reliability across infrastructure and data platforms.
• Ensure adherence to security standards, governance policies, and regulatory compliance requirements.
• Troubleshoot production issues and provide timely resolution for critical incidents.

Required Skills

DevOps & Automation

• Jenkins
• GitOps
• CI/CD Pipeline Management
• Infrastructure Automation
• Terraform
• Ansible

Containerization & Orchestration

• Kubernetes
• OpenShift
• Docker

Big Data Technologies

• Hadoop Ecosystem
• Apache Spark
• Apache Kafka

Platform & Infrastructure

• Linux Administration
• Distributed Systems
• Infrastructure Management
• Performance Tuning
• Monitoring & Observability

Security

• Security Best Practices
• Compliance & Governance Standards

Required Experience

• DevOps and CI/CD: Design, implement, and manage CI/CD pipelines using tools like Jenkins and GitOps to automate and streamline the software development lifecycle.
• Containerization and Orchestration: Deploy and manage containerized applications using Kubernetes and OpenShift, ensuring high availability and scalability.
• Infrastructure Management: Develop and maintain infrastructure as code (IaC) using tools like Terraform or Ansible.
• Big Data Solutions: Architect and implement big data solutions using technologies such as Hadoop, Spark, and Kafka.
• Distributed Systems: Design and manage distributed data architectures to ensure efficient data processing and storage.
• Collaboration
• Work closely with development, operations, and data teams to understand requirements and deliver robust solutions.
• Monitoring and Optimization: Implement monitoring solutions and optimize system performance, reliability, and scalability. Security and Compliance: Ensure infrastructure and data solutions adhere to security best practices and regulatory requirements.
• Experience working in BFSI or highly regulated environments.
• Exposure to cloud platforms such as Azure, AWS, or GCP.
• Relevant certifications in Kubernetes, DevOps, Cloud, or Hadoop technologies.
• Experience with monitoring tools such as Prometheus, Grafana, ELK, or Splunk.