Responsibilities
- Responsible for ongoing administration of Hadoop infrastructure
- Aligning with the engineering team to deploy new hardware and software environments required for Hadoop and to expand existing environments
- Working with data delivery teams to deploy Hive structures and Sentry rules
- Cluster maintenance as well as creation and removal of nodes using tools like Cloudera Manager, HDP and Mammoth
- Performance tuning of Hadoop clusters and Hadoop MapReduce routines
- Administration and protection of Cloudera Navigator Key Trustee servers and HDFS encryption zones
- Monitoring and management of Cloudera Backup and Disaster Recovery processes
- Monitor Hadoop cluster connectivity and security
- Collaborating with development teams to install operating system and Hadoop updates, patches, version upgrades when required
Skills and Qualifications
- 5+ years experience supporting complex, large-scale Production environments
- Experience administering Cloudera CDH or HDP in Production
- Familiar with Cloudera’s Backup and Disaster Recovery (BDR) solution
- Heavy experience with advanced security features such as Kerberos, Apache Sentry, SSL/TLS, Navigator encryption
- 3+ years experience performing Linux/UNIX Administration
- Excellent understanding of Active Directory/LDAP Administration
- Production experience of administering at least one RDBMS such as MySQL, Postgres, Oracle, SQL Server
- Experience of defining hardening processes for one or more Production environments
Formal Education and Certifications
- Bachelor’s degree in computer science or a related technical field, or equivalent experience
- Cloudera Certified Professional (CCP) is preferable
- Certification in one other related technology such as Red Hat Certified System Administrator (RHCSA) is preferable but not required