Job Overview
We are looking for a highly skilled and motivated DevOps Engineer to join our growing team. The successful candidate will play a key role in supporting the development, deployment and operations of enterprise-grade data and cloud platforms. You will be responsible for building and maintaining CI/CD pipelines, automating infrastructure processes and ensuring high availability and performance of platforms including Cloudera, Jenkins and cloud-native environments (AWS, Azure, GCP).
Key Responsibilities
- Design, implement and maintain robust CI/CD pipelines using Jenkins or GitLab to streamline software build, testing and deployment processes.
- Administer and support Cloudera/Hadoop (CDH/CDP) platforms, ensuring cluster performance, reliability and security.
- Automate infrastructure provisioning and configuration using Infrastructure-as-Code (IaC) tools like Terraform, CloudFormation or Ansible.
- Integrate cloud-native DevOps tools and workflows across AWS, Azure and/or GCP environments.
- Manage Git repositories and enforce best practices for source control, branching and code merger processes.
- Monitor and troubleshoot performance issues across development, test and production environments.
- Collaborate with software engineers, QA, data teams and cloud architects to deliver scalable and secure solutions.
- Develop and maintain documentation for deployment workflows, automation processes and system configurations.
- Drive DevOps best practices in areas such as automation, release management, monitoring, logging and incident response.
Requirements
- Bachelor’s degree in Computer Science, Information Technology or related field.
- 5–10 years of DevOps or SRE experience, preferably in a data platform or cloud environment.
- Proven experience with Jenkins (declarative pipelines, plugin management) and Git-based version control systems.
- Hands-on experience managing and supporting Cloudera (CDH or CDP) clusters in production environments.
- Strong scripting skills in Shell, Python or Groovy.
- Proficient in IaC tools such as Terraform, CloudFormation or Ansible.
- Familiar with DevOps tools and platforms including GitLab, AWS Lambda, CodePipeline, CodeBuild and Azure DevOps.
- Experience with monitoring/logging solutions and system performance tuning.
- Solid understanding of Linux system administration, networking fundamentals and cloud security practices.
Nice to Have
- Experience with Kubernetes, Docker and container orchestration.
- Exposure to multi-cloud environments (AWS, Azure, GCP).
- Familiarity with DevSecOps practices and secure pipeline design.
- Certifications such as AWS Certified DevOps Engineer, Azure DevOps Engineer or Cloudera Administrator.