Hadoop Engineer

Purview Services; Chandigarh; On-site; INR 3,220,000 - 4,500,000; Full time

Job summary

Purview Services is seeking an experienced Big Data Platform Engineer to join our team in India. The role focuses on managing Hadoop ecosystems, data science platforms, and containerized deployments to ensure scalable, reliable operations.

You will lead cluster management for vendor Hadoop stacks, work with Cloudera, Databricks, and OpenShift, and drive upgrades, monitoring, and disaster recovery across environments.

Qualifications

• 9+ years of experience in data platforms and operations.
• Experience with Hadoop ecosystem and data science platforms.
• Strong skills in cluster management of vendor Hadoop stacks.
• Experience with OpenShift, Docker and containerized deployments.

Responsibilities

• Handle complex, high-visibility tasks across multiple projects.
• Provide SME in Hadoop & Data Science platform ops: Cloudera, Jupyter, OpenShift, Docker.
• Integrate solutions with other apps and platforms beyond the framework.
• Manage platform ops across environments: upgrades, deployments, monitoring, DR, capacity.

Skills

Hadoop

Spark

Kafka

Docker

OpenShift

Cluster management

Data science

Jupyter Notebook

Ansible

ELK

Tools

Cloudera

Databricks

Snowflake

Talend

OpenShift

Docker

Job description

Role & responsibilities

9+ years of exeperience

• Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).


• Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc.


• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise


• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker- Container Cluster Management and Administration


• Integrates solutions with other applications and platforms outside the framework


• He/she will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident/problem/ capacity management