Hadoop Engineer

Purview Services; Gurugram District; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Purview Services in Gurugram invites a senior Big Data/Platform Operations Engineer to lead cluster management and data science platform operations. You will focus on Cloudera Hadoop, Jupyter Notebook, OpenShift, and Docker-based clusters, ensuring reliability and scale across environments.

The role requires 9+ years of experience in big data technologies, strong incident management, upgrades and deployments, and collaboration across multiple projects with cross-functional teams.

Qualifications

• 9+ years of experience in big data and platform operations.
• Experience with vendor-based Hadoop and Data Science products.
• Experience in cluster management and operations across environments.

Responsibilities

• Lead Hadoop and Data Science platform operations with focus on Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker container clusters.
• Manage upgrades, deployments, monitoring, fault resolution, and capacity planning across environments.
• Provide SME across complex projects requiring cross-functional expertise.
• Ensure integration of solutions with other applications and platforms outside the framework.
• Oversee disaster recovery, incident handling and performance forecasting.

Skills

Big Data Technologies

Cluster management

Data Science Platform operations

Tools

Docker

Docker-Container

Ansible

OpenShift

Jupyter Notebook

Hadoop

Cloudera

Job description

Role & responsibilities :

9+ years of exeperience

• Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).
• Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc.
• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker- Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework
• He/she will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident/problem/ capacity management