Hadoop Engineer

Purview Services; Coimbatore District; Hybrid; INR 2,500,000 - 4,200,000; Full time

Job summary

Purview Services is seeking a senior Big Data and Data Science Platform Operations specialist in Tamil Nadu. The role focuses on managing Hadoop ecosystems, Cloudera/Databricks deployments, and open-source tooling within a multi-environment setup.

You will lead cluster management, ensure high availability, and drive improvements across platforms like Jupyter, OpenShift, Docker, and Ansible. 9+ years of experience preferred.

Qualifications

• 9+ years of experience in big data and data platform operations.
• Experience in cluster management of vendor-based Hadoop and DS products (Cloudera, Databricks, Snowflake, etc).
• Expertise in managing Hadoop/Data Science platforms with focus on Cloudera Hadoop, Jupyter, OpenShift.

Responsibilities

• Work with Big Data technologies (Hadoop, Spark, Kafka, Impala, HBase, Docker-Container, Ansible).
• Experience in cluster management of vendor-based Hadoop and DS products (Cloudera, Databricks, Snowflake).
• Handle complex, high-visibility tasks across multiple projects requiring multiple areas of expertise.
• Provide SME on Hadoop and Data Science Platform operations (Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker).
• Manage platform operations across environments including upgrades, deployments, monitoring, DR, incidents.

Skills

Big Data

Cluster management

OpenShift

Jupyter Notebook

Tools

Hadoop

Spark

Kafka

Impala

HBase

Docker

Ansible

Job description

Role & responsibilities :

9+ years of exeperience

• Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).
• Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc.
• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker- Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework
• He/she will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident/problem/ capacity management