Senior Cloudera Hadoop Developer

Indsafri India Private Limited

South Africa

Remote

ZAR 1,200,000 - 2,200,000

Full time

13 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Indsafri India Private Limited in South Africa seeks an experienced Senior Cloudera Hadoop Developer to design, develop, and deploy robust big data solutions in the Cloudera Hadoop ecosystem. You will lead ETL processes, data pipelines, and data quality initiatives while collaborating with data scientists and analysts.

The role emphasizes hands-on Spark, Hive, HDFS, and YARN work, plus mentoring junior developers and ensuring scalable, secure data processing.

Qualifications

  • 7+ years of experience in big data development with a focus on Cloudera Hadoop.
  • Hands-on experience with Hadoop, HDFS, and YARN.
  • Proficiency in Hive for data warehousing and querying.
  • Strong programming skills in Spark (Scala/Python/Java) for large-scale data processing.
  • Experience with data modeling and database design.
  • Solid understanding of distributed systems and data processing paradigms.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration abilities.

Responsibilities

  • Design, develop, and deploy big data solutions using Cloudera Hadoop technologies.
  • Develop and optimize complex ETL processes using Hive and Spark.
  • Build and maintain data pipelines for ingestion, transformation, and processing of large datasets.
  • Utilize HDFS for efficient data storage and retrieval.
  • Configure and manage Hadoop cluster resources using YARN.
  • Troubleshoot and resolve issues related to Hadoop ecosystem components.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective solutions.
  • Mentor junior developers and contribute to best practices in big data development.
  • Ensure data quality, integrity, and security in all developed solutions.

Skills

Cloudera Hadoop
HDFS
YARN
Hive
Spark (Scala/Python/Java)
Data modeling
Distributed systems
Problem-solving
Communication

Tools

Kafka
Impala
HBase
Kudu

Job description

We are seeking an experienced Senior Cloudera Hadoop Developer with a strong background in big data technologies. The ideal candidate will be responsible for designing, developing, and implementing robust and scalable solutions on the Cloudera Hadoop ecosystem. This role requires deep technical expertise in Hadoop, HDFS, YARN, Hive, and Spark, along with a proven ability to solve complex data challenges.

Key Responsibilities:
  • Design, develop, and deploy big data solutions using Cloudera Hadoop technologies.
  • Develop and optimize complex ETL processes using Hive and Spark.
  • Build and maintain data pipelines for ingestion, transformation, and processing of large datasets.
  • Utilize HDFS for efficient data storage and retrieval.
  • Configure and manage Hadoop cluster resources using YARN.
  • Troubleshoot and resolve issues related to Hadoop ecosystem components.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective solutions.
  • Mentor junior developers and contribute to best practices in big data development.
  • Ensure data quality, integrity, and security in all developed solutions.
Required Skills and Qualifications:
  • 7+ years of experience in big data development, with a significant focus on Cloudera Hadoop.
  • In-depth knowledge and hands-on experience with Hadoop, HDFS, and YARN.
  • Proficiency in Hive for data warehousing and querying.
  • Strong programming skills in Spark (Scala/Python/Java) for large-scale data processing.
  • Experience with data modeling and database design.
  • Solid understanding of distributed systems and data processing paradigms.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration abilities.
Preferred Qualifications:
  • Experience with other big data technologies like Kafka, Impala, HBase, or Kudu.
  • Experience with cloud platforms (AWS, Azure, GCP) and their big data services.
  • Familiarity with agile development methodologies.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Cloudera Spark Developer
Senior Cloudera Spark Developer

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,800,000
Senior Cloudera Data Engineer
Senior Cloudera Data Engineer

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,800,000
Senior Cloudera Platform Engineer
Senior Cloudera Platform Engineer

Indsafri India Private Limited • South Africa

Remote
ZAR 900,000 - 1,500,000
Senior Cloudera ETL Developer
Senior Cloudera ETL Developer

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,900,000
Senior Cloudera Administrator
Senior Cloudera Administrator

Indsafri India Private Limited • South Africa

Remote
ZAR 900,000 - 1,500,000
Senior Cloudera Hadoop Architect for Big Data Solutions
Senior Cloudera Hadoop Architect for Big Data Solutions

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 2,200,000
Intermediate Cloudera Platform Engineer
Intermediate Cloudera Platform Engineer

Indsafri India Private Limited • South Africa

Remote
ZAR 600,000 - 1,000,000
Senior Cloudera Data Engineer — Scalable Pipeline Lead
Senior Cloudera Data Engineer — Scalable Pipeline Lead

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,800,000
Cloudera Data Architect
Cloudera Data Architect

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,800,000
Junior Cloudera Machine Learning Engineer
Junior Cloudera Machine Learning Engineer

Indsafri India Private Limited • South Africa

Remote
ZAR 350,000 - 550,000