Cloudera Data Engineer

Midis Group; Dubai; On-site; AED 120,000 - 200,000; Full time

Job summary

A technology solutions company in Dubai is seeking an experienced Cloudera Data Engineer with expertise in Cloudera CDP and the Hadoop ecosystem. The role involves designing and maintaining big data pipelines, optimizing workflows, and supporting production environments. Ideal candidates should have strong SQL skills, experience with cloud platforms like AWS or Azure, and a Bachelor’s degree in Computer Science or a related field. This position offers a challenging environment to work on data-driven initiatives.

Qualifications

• Strong hands-on experience with Cloudera CDP.
• Proficiency in Hadoop ecosystem: HDFS, YARN, MapReduce, Hive, Impala.
• Experience in troubleshooting and production support in big data environments.

Responsibilities

• Design, build, and maintain big data pipelines using Cloudera CDP components.
• Develop and optimize ETL/ELT workflows using Spark, Hive, and Hadoop.
• Manage HDFS storage, ensuring high availability and performance.

Skills

Cloudera CDP

Hadoop ecosystem

Apache Spark

SQL

Linux

Shell scripting

Education

Bachelor's degree in Computer Science or related field

Tools

Git

AWS

Docker

Kubernetes

Job description

Job Title

Cloudera Data Engineer

Job Scope

We are seeking an experienced Cloudera Data Engineer with strong hands‑on expertise in Cloudera CDP, Hadoop, Spark, Hive, and HDFS. The ideal candidate will be responsible for building and maintaining big data pipelines, optimizing data workflows, and supporting production environments to ensure reliability and performance.

Main Duties and Responsibilities

• Design, build, and maintain big data pipelines using Cloudera CDP components.


• Develop and optimize ETL/ELT workflows using Spark, Hive, and Hadoop ecosystems.


• Manage and maintain HDFS storage, ensuring high availability and performance.


• Perform production support activities, including issue resolution, monitoring, and performance tuning.


• Work with data scientists, analysts, and other engineering teams to support data-driven initiatives.


• Ensure data governance, security, and compliance across big data environments.


• Troubleshoot cluster‑level issues related to resource utilization, scheduling, and configuration.


• Participate in solution design, architecture discussions, and technical documentation.

Position Requirements

• Strong hands‑on experience with Cloudera CDP.


• Proficiency in Hadoop ecosystem: HDFS, YARN, MapReduce, Hive, Impala.


• Strong experience working with Apache Spark (PySpark or Scala preferred).


• Solid understanding of distributed systems and big data architecture.


• Experience with production support and troubleshooting in big data environments.


• Strong SQL skills and experience optimizing large‑scale queries.


• Familiarity with Linux, shell scripting, and automation tools.


• Experience with version control (Git) and CI/CD workflows is a plus.

Education

Bachelor's degree in Computer Science or any other related field

Experience

• Experience with cloud platforms (AWS, Azure, GCP) for big data workloads.


• Exposure to Kafka, NiFi, Oozie, or similar data orchestration tools.


• Knowledge of Docker, Kubernetes, or containerized environments.


• Understanding of security, encryption, and data governance concepts.