Hadoop Engineer

Purview Services; Indore District; Hybrid; INR 1,500,000 - 2,100,000; Full time

Job summary

Purview Services in India seeks an experienced Big Data Platform Engineer to lead and support data infrastructure operations. You will manage Hadoop clusters and data science platforms, focusing on Cloudera Hadoop, OpenShift, Jupyter Notebook, and Docker-based environments.

You will oversee upgrades, deployments, monitoring, disaster recovery, and capacity planning across on-prem and cloud environments, collaborating with cross-functional teams on high-visibility data projects.

Qualifications

• 9+ years of experience in big data and platform operations.
• Experience in managing Hadoop clusters and data science platforms.
• Strong knowledge of Cloudera Hadoop, Jupyter Notebook, OpenShift and Docker-based environments.

Responsibilities

• Lead and manage big data platform operations, upgrades, and deployments across environments.
• Provide SME guidance for Hadoop and Data Science Platform operations.
• Ensure monitoring, disaster recovery, incident management and capacity planning.

Skills

Big Data Technologies

Hadoop

Spark

Kafka

Containerization (Docker/OpenShift)

Tools

Cloudera Hadoop

Databricks

Snowflake

Talend

ELK

Jupyter Notebook

OpenShift

Docker-Container

Job description

Role & responsibilities :

9+ years of exeperience

• Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).
• Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc.
• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker- Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework
• He/she will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident/problem/ capacity management