Senior Cloudera Platform Engineer

Indsafri India Private Limited

South Africa

Remote

ZAR 900,000 - 1,500,000

Full time

13 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Indsafri India Private Limited seeks a Senior Cloudera Platform Engineer to design, deploy, and manage large-scale CDP environments across cloud providers and on-premises infrastructure. You will optimize Hadoop components, orchestrate Kubernetes, and drive automation with Python, Bash, and Ansible.

You will ensure data security, governance, and performance while collaborating with data scientists and engineers to meet data needs and scale the platform.

Qualifications

  • 7+ years of hands-on experience in designing, deploying, and managing Cloudera Data Platform (CDP) or other Hadoop distributions.
  • In-depth knowledge of cloud platforms (AWS, Azure, or GCP) and their relevant services for data platforms.
  • Strong experience with containerization technologies, particularly Kubernetes, including deployment, management, and troubleshooting.
  • Proficiency in scripting languages such as Python, Bash, or PowerShell for automation.
  • Familiarity with CI/CD principles and tools.
  • Excellent understanding of networking concepts and security best practices.
  • Strong problem-solving and analytical skills with the ability to troubleshoot complex distributed systems.
  • Effective communication and collaboration skills.

Responsibilities

  • Design, deploy, and maintain CDP environments across cloud providers and on-premises infrastructure.
  • Manage and optimize Hadoop ecosystem components within CDP (HDFS, YARN, Hive, Impala, Spark, Kafka, HBase).
  • Administer and orchestrate Kubernetes clusters integrated with CDP for containerized data services.
  • Perform system monitoring, performance tuning, and capacity planning for the Cloudera platform.
  • Develop automation scripts for deployment, configuration, patching, and maintenance (Ansible, Python, Shell).
  • Troubleshoot complex issues related to Cloudera platform and services.
  • Ensure data security, compliance, and governance best practices.
  • Collaborate with data scientists and engineers to support data needs and provide platform expertise.
  • Stay up to date with big data, cloud, and containerization trends.
  • Document platform architecture and procedures.

Skills

Python
AWS
GCP
Azure
Kubernetes
Bash
PowerShell
Ansible
Terraform
CloudFormation
IaC
Hadoop
CDP
Hive
Spark
Kafka
HBase
YARN
Linux
CI/CD
Grafana
Prometheus
Splunk
Security
Networking
Data Governance
Data Lineage
Cloud-native data services
Terraform
Cloudera certifications
CCA Administrator
CCA Data Scientist

Tools

Kubernetes
Prometheus
Grafana
Splunk
Terraform
CloudFormation
Ansible

Job description

We are seeking a highly experienced and motivated Senior Cloudera Platform Engineer to join our dynamic data engineering team. The ideal candidate will have a strong background in designing, implementing, and managing large-scale Cloudera Data Platform (CDP) environments. This role requires deep expertise in distributed systems, cloud technologies, Kubernetes, Linux administration, and automation to ensure the stability, performance, and scalability of our data infrastructure.

Key Responsibilities

  • Design, deploy, and maintain Cloudera Data Platform (CDP) environments across various cloud providers (AWS, Azure, GCP) and on-premises infrastructure.
  • Manage and optimize Hadoop ecosystem components within CDP, including HDFS, YARN, Hive, Impala, Spark, Kafka, and HBase.
  • Administer and orchestrate Kubernetes clusters integrated with CDP for containerized data services.
  • Perform regular system monitoring, performance tuning, and capacity planning for the Cloudera platform.
  • Develop and implement automation scripts for deployment, configuration, patching, and maintenance of the CDP environment using tools like Ansible, Python, or Shell scripting.
  • Troubleshoot and resolve complex technical issues related to the Cloudera platform and its integrated services.
  • Ensure data security, compliance, and governance best practices are implemented and maintained.
  • Collaborate with data scientists, data engineers, and application developers to support their data needs and provide platform expertise.
  • Stay up to date with the latest trends and technologies in big data, cloud computing, and containerization.
  • Document platform architecture, configurations, and operational procedures.

Required Skills and Qualifications

  • 7+ years of hands-on experience in designing, deploying, and managing Cloudera Data Platform (CDP) or other Hadoop distributions.
  • In-depth knowledge of cloud platforms (AWS, Azure, or GCP) and their relevant services for data platforms.
  • Strong experience with containerization technologies, particularly Kubernetes, including deployment, management, and troubleshooting.
  • Proficiency in scripting languages such as Python, Bash, or PowerShell for automation.
  • Familiarity with CI/CD principles and tools.
  • Excellent understanding of networking concepts and security best practices.
  • Strong problem-solving and analytical skills with the ability to troubleshoot complex distributed systems.
  • Effective communication and collaboration skills.

Preferred Qualifications

  • Cloudera certifications (e.g., CCA Administrator, CCA Data Scientist).
  • Experience with cloud-native data services and their integration with CDP.
  • Knowledge of monitoring tools like Prometheus, Grafana, or Splunk.
  • Experience with Infrastructure as Code (IaC) tools such as Terraform or CloudFormation.
  • Familiarity with data governance and data lineage tools.
Skills

Python AWS GCP Azure analytical skills Problem-Solving communication Kubernetes Grafana Prometheus CI/CD Bash Powershell Collaboration Data Governance CloudFormation Infrastructure as Code (IaC) Ubuntu Ansible Terraform hdfs shell scripting centos splunk networking rhel kafka impala spark Hive Security YARN HBase Hadoop Ecosystem Linux system administration Cloudera Data Platform (CDP) Cloudera certifications CCA Administrator CCA Data Scientist cloud-native data services Data lineage tools

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Intermediate Cloudera Platform Engineer
Intermediate Cloudera Platform Engineer

Indsafri India Private Limited • South Africa

Remote
ZAR 600,000 - 1,000,000
Senior Cloudera Data Engineer
Senior Cloudera Data Engineer

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,800,000
Senior Cloudera Administrator
Senior Cloudera Administrator

Indsafri India Private Limited • South Africa

Remote
ZAR 900,000 - 1,500,000
Cloudera Data Architect
Cloudera Data Architect

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,800,000
Senior Cloudera Hadoop Developer
Senior Cloudera Hadoop Developer

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 2,200,000
Senior Cloudera Spark Developer
Senior Cloudera Spark Developer

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,800,000
Senior Cloudera CDP Platform Engineer | Scale &Automation
Senior Cloudera CDP Platform Engineer | Scale &Automation

Indsafri India Private Limited • South Africa

Remote
ZAR 900,000 - 1,500,000
CDP Platform Engineer — Kubernetes & Cloud Automation
CDP Platform Engineer — Kubernetes & Cloud Automation

Indsafri India Private Limited • South Africa

Remote
ZAR 600,000 - 1,000,000
Senior Cloudera Platform Admin – CDP Expert
Senior Cloudera Platform Admin – CDP Expert

Indsafri India Private Limited • South Africa

Remote
ZAR 900,000 - 1,500,000
Senior Cloudera Data Engineer — Scalable Pipeline Lead
Senior Cloudera Data Engineer — Scalable Pipeline Lead

Indsafri India Private Limited • South Africa

Remote
ZAR 1,200,000 - 1,800,000