Hadoop Engineer

Purview Services; Ernakulam; On-site; INR 1,800,000 - 2,600,000; Full time

Job summary

Purview Services in India is seeking a seasoned Big Data professional with 9+ years of experience to lead platform operations. The role emphasizes Hadoop ecosystem management, data science tooling, and containerized deployments, with responsibilities spanning upgrades, monitoring, and disaster recovery.

You will work across Cloudera Hadoop, Jupyter Notebook, OpenShift and Docker-based clusters, ensuring robust performance and integration with other systems.

Qualifications

• 9+ years of experience in big data and platform operations.
• Experience with vendor-based Hadoop and data science products.

Responsibilities

• Manage Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker-Container Cluster Management and Administration
• Integrate solutions with other applications and platforms outside the framework
• Oversee platform operations across all environments including upgrades, deployments, monitoring, disaster recovery and capacity management

Tools

Hadoop

Spark

Kafka

Impala

HBase

Docker

Ansible

Job description

Role & responsibilities :

9+ years of exeperience

• Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).
• Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc.
• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker- Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework
• He/she will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident/problem/ capacity management