Senior Cloudera ETL Architect: Spark, NiFi & Data Pipelines

Indsafri India Private Limited

South Africa

Remote

ZAR 1,200,000 - 1,900,000

Full time

13 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Indsafri India Private Limited is seeking a Senior Cloudera ETL Developer with 7+ years of experience to design, build, and optimize robust data pipelines. You will work across NiFi, Spark, and SQL to deliver scalable ETL solutions in a Cloudera environment.

The role emphasizes data governance, quality, and security, with collaboration across data engineers, scientists, and business analysts to translate requirements into performant data platforms.

Qualifications

  • 7+ years of ETL development and data engineering experience.
  • Proven expertise with Apache NiFi for designing data flows.
  • Strong Spark experience (PySpark/Scala) for large-scale processing.
  • Advanced SQL skills and query optimization.
  • Experience with Cloudera ecosystem (HDFS, Hive, Impala).
  • Knowledge of data warehousing, data modeling and DB design.

Responsibilities

  • Design, develop, and maintain high-performance ETL pipelines using Cloudera tech (NiFi, Spark).
  • Write efficient SQL to extract, transform, and load data into warehouses and lakes.
  • Develop and optimize Spark jobs for large-scale processing.
  • Build data flows with NiFi and orchestrate ETL processes.
  • Collaborate with data engineers, scientists, and analysts to meet data needs.
  • Troubleshoot pipeline issues and improve performance and data quality.
  • Implement data governance, quality, and security in ETL processes.
  • Document ETL processes, data models, and specs.
  • Mentor junior developers and grow the team’s capabilities.
  • Stay updated on big data trends and ETL tech.

Skills

ETL development
Data engineering
SQL proficiency
Python/Bash scripting
Big data concepts

Tools

Apache NiFi
Apache Spark
Hadoop HDFS
Hive/Impala
CI/CD pipelines
Git

Job description

Indsafri India Private Limited is seeking a Senior Cloudera ETL Developer with 7+ years of experience to design, build, and optimize robust data pipelines. You will work across NiFi, Spark, and SQL to deliver scalable ETL solutions in a Cloudera environment.

The role emphasizes data governance, quality, and security, with collaboration across data engineers, scientists, and business analysts to translate requirements into performant data platforms.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Cloudera ETL Developer
Senior Cloudera ETL Developer

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,900,000
Senior Cloudera Data Engineer — Scalable Pipeline Lead
Senior Cloudera Data Engineer — Scalable Pipeline Lead

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,800,000
Senior Spark Engineer - Cloudera Data Platform
Senior Spark Engineer - Cloudera Data Platform

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,800,000
Senior Cloudera Hadoop Architect for Big Data Solutions
Senior Cloudera Hadoop Architect for Big Data Solutions

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 2,200,000
Senior Cloudera Data Engineer
Senior Cloudera Data Engineer

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,800,000
Senior Cloudera Spark Developer
Senior Cloudera Spark Developer

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,800,000
Senior Data Engineer: Spark, Databricks & Cloud Pipelines
Senior Data Engineer: Spark, Databricks & Cloud Pipelines

Boardroom Appointments • Sandton

On-site
ZAR 900,000 - 1,500,000
Senior Cloudera CDP Platform Engineer | Scale &Automation
Senior Cloudera CDP Platform Engineer | Scale &Automation

Indsafri India Private Limited • South Africa

Remote
ZAR 900,000 - 1,500,000
Senior Cloudera Hadoop Developer
Senior Cloudera Hadoop Developer

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 2,200,000
Senior Cloudera Data Architect — CDP & Data Governance
Senior Cloudera Data Architect — CDP & Data Governance

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,800,000