Hadoop Engineer

Purview Services; Jaipur; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

Purview Services seeks an experienced Big Data & Platform Operations specialist in Jaipur. You will manage and optimize Big Data technologies, lead cluster management for vendor-based Hadoop ecosystems, and drive Data Science platform operations with a focus on Cloudera Hadoop, Jupyter Notebook, OpenShift, and Docker container clusters.

The role requires deep SME knowledge and hands-on expertise in deploying, upgrading, and monitoring complex data platforms across environments, ensuring

Qualifications

• 9+ years of experience in Big Data and related technologies.

Responsibilities

• Manage Big Data technologies stack including Hadoop, Spark, Kafka, Impala, HBase and containerized environments.
• Oversee cluster management of vendor-based Hadoop and Data Science products (Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite).
• Provide SME guidance in Hadoop and Data Science Platform operations focusing on Cloudera Hadoop, Jupyter Notebook, OpenShift, and Docker container cluster management and administration.
• Integrate cross-application solutions within the platform and ensure seamless operation across environments.
• Lead platform operations including upgrades, bug fixes, deployments, monitoring, capacity planning, disaster recovery, and incident management.

Skills

Big Data Technologies

Hadoop cluster management

Data Science platform operations

Tools

Docker-Container

OpenShift

Jupyter Notebook

Ansible

Job description

Role & responsibilities :

9+ years of exeperience

• Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).
• Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc.
• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker- Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework
• He/she will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident/problem/ capacity management