Hadoop Engineer

Purview Services; Khordha; On-site; INR 3,000,000 - 6,500,000; Full time

Job summary

Purview Services is seeking a Senior Big Data Platform Engineer to lead Hadoop and data science platform operations. You will manage Cloudera Hadoop, Jupyter Notebook, and OpenShift across environments, ensuring upgrades, reliability, and performance.

You will collaborate with cross-functional teams on complex, high-visibility projects, deploying containerized architectures, monitoring, disaster recovery, and capacity planning while driving efficiency and best practices.

Qualifications

• 9+ years of experience in large-scale data/platform operations.
• Experience in cluster management of vendor Hadoop and DS products (Cloudera, Databricks, Snowflake, etc).
• Subject matter expertise in Hadoop and DS platform operations with focus on Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker container cluster management.

Responsibilities

• Manage Hadoop and Data Science Platform operations with focus around Cloudera Hadoop.
• Oversee upgrades, deployments, monitoring, and capacity planning across environments.
• Coordinate incident response and disaster recovery planning for platform services.

Skills

Big Data

Tools

Hadoop

Spark

Kafka

Impala

HBase

Docker

Ansible

Cloudera

Databricks

Snowflake

Talend

ELK

Jupyter Notebook

OpenShift

Job description

Role & responsibilities :

9+ years of exeperience

• Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).
• Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc.
• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker- Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework
• He/she will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident/problem/ capacity management