Senior Cloudera & Operations Engineer

Iwork Solutions; Mumbai; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Iwork Solutions in Mumbai seeks an experienced Cloudera Data Platform administrator to lead installation, configuration, security (Kerberos, Ranger), performance tuning (HDFS, YARN, Spark, Kafka), upgrades, monitoring, and automation using Shell and Python. You will ensure platform stability for data teams.

The role requires 10+ years of hands-on CDP experience, managing large clusters, and guiding a team of 5–6 engineers.

Qualifications

• 10+ years hands-on Cloudera platform experience.
• Experience managing large clusters and leading teams.
• Strong troubleshooting and performance tuning skills.

Responsibilities

• Manage and maintain CDP installation, configuration, security, and upgrades.
• Monitor cluster health with Cloudera Manager and perform capacity planning.
• Lead a technical team of 5–6 members for platform operations.
• Coordinate with security for platform audit adherence.
• Troubleshoot service failures and optimize data workflows.

Skills

Cloudera CDP administration

Linux/Unix expertise

Shell/Python scripting

Kerberos & Ranger security

HDFS/YARN/Spark/Kafka tuning

Cloudera Manager monitoring

Automation scripting

Tools

Cloudera Manager

Spark

Kafka

Hadoop ecosystem

Job description

Job Description

• Manage and maintain cloudera data platform (CDP) focusing on installation, configuration, security (Kerberos, Ranger), performance tuning (HDFS, YARN,
  Spark, Kafka), upgrades, monitoring (Cloudera Manager), and automation (Shell/Python scripting) to ensure platform stability, scalability, and optimal
  performance for data teams, requiring Linux/Unix skills and strong troubleshooting abilities
• Data lifecycle management to ensure optimal storage optimization and cost optimization
• Monitor cluster health and performance using Cloudera Manager; perform capacity planning, resource tuning, and proactive issue resolution
• Perform upgrades, patching, and backup/recovery operations across Cloudera components, ensuring minimal downtime and compliance with SLAs
• Troubleshoot and resolve cluster-level issues including service failures, job errors, and performance bottlenecks using logs, metrics, and diagnostic too
• Manage and lead team of 6 people for platform administration and operation
• Coordinate and collaborate with technology and security for platform audit review and adherence to guidelines
• Strong understanding of data integration techniques and best practices
• Familiarity with big data technologies and frameworks
• Troubleshoot and optimize workflows, provide infrastructure recommendation, managing Development, Production and DR setup

Experience

• 10+ years mandatory hands-on experience in Cloudera data platform administration, operation, monitoring, performance tuning and management
• Experience in managing large cluster
• Experience in leading technical team of 5 to 6 member in cloudera data platform
• Automation of cloudera platform operation through scripts, performance tuning experience, resolving issues proactively