Hadoop Engineer

Purview Services; Nagpur District; On-site; INR 1,800,000 - 2,600,000; Full time

Job summary

Purview Services is seeking a senior professional with 9+ years of experience in big data technologies to lead and manage platform operations. The role focuses on Hadoop ecosystems, data science tools, and platform administration across environments.

The candidate will drive upgrades, deployments, monitoring, and disaster recovery, while integrating cross-platform solutions and handling high-visibility tasks requiring diverse expertise.

Qualifications

• 9+ years of experience in big data technologies.
• Experience in cluster management of vendor-based Hadoop and Data Science products (e.g., Cloudera, Databricks, Snowflake, Talend, ELK, KPMG Ignite).

Responsibilities

• Manage Hadoop and Data Science Platform operations with focus on Cloudera Hadoop, Jupyter Notebook, OpenShift, and Docker-Container cluster management.
• Oversee upgrades, deployments, monitoring, and capacity management; ensure disaster recovery and incident handling.
• Integrate solutions with other applications and platforms outside the framework.
• Handle complex, major or highly visible tasks spanning multiple projects and areas of expertise.

Skills

Hadoop

Spark

Kafka

Impala

HBase

Docker

Ansible

Cloudera Hadoop

Jupyter Notebook

OpenShift

Job description

Role & responsibilities :

9+ years of exeperience

• Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).
• Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc.
• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker- Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework
• He/she will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident/problem/ capacity management