Hadoop Engineer

Purview Services; Dadri; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Purview Services seeks an experienced Big Data Platform Operations specialist with 9+ years in managing Hadoop and data science platforms. The role focuses on cluster management, upgrades, deployments, monitoring and capacity planning across multiple environments.

The ideal candidate will have hands-on experience with Cloudera Hadoop, Jupyter Notebook, OpenShift and Docker, driving reliable platform operations and incident response for enterprise projects.

Qualifications

• 9+ years of experience in Big Data technologies.
• Experience in cluster management of vendor-based Hadoop and Data Science products.
• Expertise in Hadoop and Data Science Platform operations (Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker).
• Responsible for upgrades, deployments, monitoring, disaster recovery, incident and capacity management.

Responsibilities

• Manage platform operations across all environments including upgrades, bug fixes and deployments.
• Monitor metrics and ensure performance, reliability and capacity planning.
• Lead cluster management for Hadoop and data science platforms.
• Provide subject matter expertise in Hadoop and data science platform operations.

Skills

Big Data

Hadoop

Spark

Kafka

Impala

HBase

Docker

Ansible

Cloudera

OpenShift

Jupyter Notebook

Tools

Docker

OpenShift

Ansible

Jupyter Notebook

Job description

Role & responsibilities :

9+ years of exeperience

• Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).
• Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc.
• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker- Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework
• He/she will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident/problem/ capacity management