Cloudera Data Engineer: Build Big Data Pipelines

Maaloomatiia; Dubai; On-site; AED 223,200 - 334,800; Full time

Job summary

A leading data services company in Dubai seeks an experienced Cloudera Data Engineer to design and maintain big data pipelines. The role involves developing and optimizing ETL workflows using Cloudera CDP components like Hadoop and Spark, managing HDFS storage, and ensuring data governance across environments. Candidates should have strong skills in SQL and distributed systems, with a Bachelor's degree in Computer Science. Experience with cloud platforms is preferred, making this a crucial role for data-driven initiatives.

Qualifications

• Strong hands-on experience with Cloudera CDP.
• Proficiency in Hadoop ecosystem: HDFS, YARN, MapReduce, Hive, Impala.
• Strong experience with Apache Spark (PySpark or Scala preferred).
• Solid understanding of distributed systems and big data architecture.

Responsibilities

• Design, build, and maintain big data pipelines using Cloudera CDP components.
• Develop and optimize ETL/ELT workflows using Spark, Hive, and Hadoop ecosystems.
• Manage and maintain HDFS storage for high availability and performance.
• Perform production support activities including issue resolution.

Skills

Cloudera CDP

Hadoop

Spark

Hive

HDFS

SQL

Linux

Shell scripting

Education

Bachelor's degree in Computer Science or related field

Tools

Apache Spark

Docker

Kubernetes

Git

Job description

A leading data services company in Dubai seeks an experienced Cloudera Data Engineer to design and maintain big data pipelines. The role involves developing and optimizing ETL workflows using Cloudera CDP components like Hadoop and Spark, managing HDFS storage, and ensuring data governance across environments. Candidates should have strong skills in SQL and distributed systems, with a Bachelor's degree in Computer Science. Experience with cloud platforms is preferred, making this a crucial role for data-driven initiatives.