Big Data Administrator / Admin / Hadoop Admin

Lancesoft Europe; United Arab Emirates; On-site; AED 120,000 - 200,000; Full time

Job summary

A leading tech firm is seeking a Cloudera Administrator in the United Arab Emirates. The successful candidate will manage and maintain Cloudera's big data platform, ensuring optimal performance, security, and scalability of Hadoop-based systems. Responsibilities include monitoring clusters, handling security measures, and troubleshooting service issues. Experience with Cloudera Manager and strong Hadoop knowledge is required.

Benefits

Flexible working hours

Health insurance

Professional development opportunities

Qualifications

• Experience managing and maintaining Cloudera's big data platform.
• Strong understanding of Hadoop-based systems.
• Knowledge of security and access control mechanisms.

Responsibilities

• Manage roles and responsibilities within the data ecosystem.
• Monitor cluster health and performance using Cloudera Manager.
• Ensure compliance with data management standards.

Skills

Cloudera Manager

Hadoop

LDAP

Active Directory

Performance Tuning

Job description

Overview

A Cloudera Administrator managing and maintaining Cloudera's big data platform, ensuring optimal performance, security, and scalability of Hadoop-based systems.

Responsibilities

1. Role Management
   • Balancer: Balances data blocks across nodes.
   • DataNode: Manages storage and retrieval of data blocks.
   • NameNode: Manages metadata and namespace for HDFS.
   • SecondaryNameNode: Periodically merges namespace image with edit logs.
2. Monitoring and Performance Tuning
   • Use Cloudera Manager to monitor cluster health, resource usage, and service performance.
   • Tune configurations for optimal performance and resource utilization.
   • Set up alerts and dashboards for proactive issue detection.
3. Security and Access Control
   • Implement authentication and authorization using LDAP / Active Directory.
   • Manage user roles and permissions across Cloudera services.
   • Ensure data encryption and secure communication between nodes.
4. Disaster Recovery
5. Troubleshooting and Support
   • Diagnose and resolve issues related to service failures, performance bottlenecks, and data inconsistencies.
   • Work with Cloudera support and internal teams to escalate and resolve complex problems.
6. Upgrades and Patching
   • Plan and execute upgrades of Cloudera Manager and cluster components.
   • Apply patches and hotfixes as needed to maintain system stability and security.
7. Documentation and Compliance
   • Maintain detailed documentation of cluster architecture, configurations, and operational procedures.
   • Ensure compliance with organizational and regulatory standards for data management.

Enable Skills-Based Hiring