Assistant Manager - Big Data Administrator - Cloudera (Mashreq Global Network Pakistan)

Mashreq; Karachi Division; On-site; PKR 1,800,000 - 3,000,000; Full time

Job summary

Mashreq is seeking an experienced Cloudera Administrator with 4–7 years of hands-on experience to manage our enterprise Hadoop ecosystem. You will ensure stability, performance, and security of Cloudera clusters while supporting data ingestion and analytics workloads.

The role requires strong Linux system administration, Cloudera Manager expertise, and experience with security integrations like Kerberos and LDAP/AD. Remote cloud deployments are a plus.

Qualifications

• Bachelor’s degree in CS/IT or related field, or equivalent experience.
• 4–7 years hands-on Cloudera/Hadoop administration.
• Strong Linux/Unix admin and shell scripting skills.
• Expertise in HDFS, YARN, Hive, Spark, Impala, Kafka, HBase.
• Cloudera Manager knowledge for monitoring and cluster admin.
• Security: Kerberos, Ranger, Sentry, LDAP/AD integration.
• Troubleshooting, log analysis, and performance tuning.
• Backup, recovery, and disaster recovery for big data.
• Cloud knowledge (AWS/Azure/GCP) is a plus.

Responsibilities

• Install, configure, and maintain CDP/CDH clusters in prod and non-prod environments.
• Monitor cluster health, performance, and resource usage.
• Manage Hadoop ecosystem components (HDFS, YARN, Hive, Spark, etc.).
• Perform upgrades, patches, and migrations with minimal downtime.
• Implement security controls and access management.
• Automate admin tasks with Python, Shell, or Ansible.
• Troubleshoot cluster issues and job failures.
• Support disaster recovery planning for Hadoop clusters.
• Collaborate with Data Engineers and Architects to optimize data pipelines.
• Generate usage and capacity reports.

Skills

Linux/Unix administration

Shell scripting

Troubleshooting & performance tuning

Cloud platforms knowledge

Education

Bachelor's degree in CS/IT or equivalent

Tools

Cloudera Manager

CDP/CDH Hadoop stacks

Hadoop ecosystem components

Job description

We are seeking an experienced Cloudera Administrator with 4 to 7 years of experience to manage, configure, and support our enterprise-grade Cloudera Hadoop ecosystem. This role involves ensuring the stability, performance, and security of Cloudera clusters, along with supporting data ingestion, processing, and analytics workloads. The ideal candidate will have strong expertise in Cloudera/HDP/CDP distributions, Linux system administration, and enterprise big data platforms.

Key Responsibilities

• Install, configure, and maintain Cloudera Data Platform (CDP) or Cloudera Distribution of Hadoop (CDH) clusters in production and non-production environments.
• Monitor cluster health, performance, and resource utilization, ensuring high availability and reliability.
• Manage and support Hadoop ecosystem components (HDFS, YARN, Hive, Impala, Spark, HBase, Kafka, Oozie, Zookeeper, Ranger, Atlas, etc.).
• Perform cluster upgrades, patches, and migrations with minimal downtime.
• Implement and maintain security controls using Kerberos, Ranger, and LDAP/AD integration.
• Manage user access, roles, and privileges across the Cloudera ecosystem.
• Automate routine administrative tasks using Python, Shell scripting, or Ansible.
• Troubleshoot cluster-related issues, performance bottlenecks, and job failures.
• Support backup and disaster recovery planning for Hadoop clusters.
• Collaborate with Data Engineers, Developers, and Architects to optimize data pipelines and workflows.
• Generate reports on cluster usage, job performance, and capacity planning.

Required Skills & Qualifications

• Bachelor’s degree in computer science, Information Technology, or related field (or equivalent experience).
• 4 to 7 years of hands-on experience administering Cloudera/Hadoop ecosystems.
• Strong experience with Linux/Unix system administration and shell scripting.
• Expertise in Hadoop ecosystem components (HDFS, YARN, Hive, Spark, Impala, Kafka, HBase).
• Knowledge of Cloudera Manager for monitoring, configuration, and cluster administration.
• Familiarity with Kerberos, Ranger, Sentry, and LDAP/AD integration for security.
• Proficiency in troubleshooting, log analysis, and performance tuning.
• Experience in backup, recovery, and disaster recovery strategies for big data platforms.
• Knowledge of cloud platforms (AWS, Azure, GCP) and cloud-based Cloudera deployments is a plus.

Preferred Qualifications

• Cloudera Certified Administrator for Apache Hadoop (CCAH) or equivalent certification.
• Familiarity with containerization (Docker, Kubernetes) for big data workloads.
• Knowledge of SQL, Python, PySpark for debugging data pipelines.