We are seeking a highly experienced and skilled Senior Cloudera Administrator with a minimum of 7 years of hands-on experience. The ideal candidate will be
responsible for the installation, configuration, management, and ongoing maintenance of our Cloudera Data Platform (CDP) environments. This role requires
deep expertise in Cloudera Manager, HDFS, YARN, and Linux operating systems to ensure optimal performance, scalability, and reliability of our big data
infrastructure.
Key Responsibilities:
- Install, configure, and upgrade Cloudera Data Platform (CDP) components.
- Administer and manage Cloudera Manager for cluster monitoring, health checks, and performance tuning.
- Manage and optimize Hadoop Distributed File System (HDFS) for data storage and accessibility.
- Configure and maintain YARN (Yet Another Resource Negotiator) for efficient resource allocation and job scheduling.
- Perform regular system maintenance, patching, and security updates on Cloudera clusters.
- Troubleshoot and resolve complex issues related to Cloudera services, HDFS, YARN, and underlying Linux infrastructure.
- Implement and manage security configurations for the Cloudera environment, including Kerberos and authorization.
- Develop and implement backup and disaster recovery strategies for big data clusters.
- Monitor cluster performance, identify bottlenecks, and implement solutions for performance improvement.
- Collaborate with development and data science teams to ensure optimal cluster utilization and performance for their applications.
- Provide technical guidance and mentorship to junior administrators.
- Document system configurations, processes, and troubleshooting procedures.
Required Skills and Qualifications:
- Minimum of 7 years of experience in administering and managing Cloudera clusters.
- Proven expertise with Cloudera Data Platform (CDP) environments.
- In-depth knowledge and hands-on experience with Cloudera Manager.
- Strong understanding of HDFS architecture, administration, and best practices.
- Proficiency in YARN configuration, management, and troubleshooting.
- Experience with cluster security implementation (e.g., Kerberos, Sentry, Ranger).
- Solid understanding of networking concepts relevant to distributed systems.
- Excellent problem-solving and analytical skills.
- Strong communication and interpersonal skills.
Preferred Qualifications:
- Cloudera Certified Administrator (CCA) or Cloudera Certified Master Administrator (CCMA) certification.
- Experience with cloud platforms (AWS, Azure, GCP) and their integration with Cloudera.
- Familiarity with other big data technologies such as Spark, Hive, Impala, Kafka, and Solr.
- Experience with automation tools like Ansible, Puppet, or Chef.
- Knowledge of containerization technologies like Docker and Kubernetes.