Hadoop Engineer

Purview Services; Ghaziabad District; On-site; INR 2,400,000 - 4,200,000; Full time

Job summary

Purview Services in India seeks a senior specialist to lead big data platform operations. You will manage multi-environment Hadoop and data science platforms, focusing on vendor-based clusters and containerized deployments.

The role requires 9+ years’ experience with Cloudera Hadoop, Jupyter Notebook, OpenShift, and Docker, ensuring upgrades, monitoring, DR, and capacity management across projects.

Qualifications

• 9+ years of experience in big data and platform operations.
• Experience in cluster management of vendor Hadoop and data science products.
• Proven expertise in Hadoop/Data Science platform operations and containerized environments.

Responsibilities

• Manage platform operations across environments including upgrades, deployments, monitoring, and disaster recovery.
• Provide SME guidance for Hadoop and data science platform administration (Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker).
• Coordinate integration of data platforms with other applications and ensure capacity planning.

Skills

Big data

Tools

Hadoop

Spark

Kafka

Impala

HBase

Docker

Ansible

Cloudera

Databricks

Snowflake

Talend

ELK

KPMG Ignite

Jupyter Notebook

OpenShift

Job description

Role & responsibilities :

9+ years of exeperience

• Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).
• Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc.
• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker- Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework
• He/she will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident/problem/ capacity management