Hadoop Engineer

Purview Services; Surat; Hybrid; INR 1,800,000 - 3,000,000; Full time

Job summary

Purview Services in Surat, India is seeking a senior Big Data engineer with 9+ years of experience to lead complex Hadoop and data science platform operations.

You will manage clusters (Cloudera, Databricks, Snowflake), containerization (Docker/OpenShift), and automation (Ansible), ensuring deployments, monitoring, and disaster recovery across environments. The role requires collaborating across projects and delivering scalable data solutions with reliability.

Qualifications

• 9+ years of experience in big data environments.
• Experience with Hadoop and data science platforms.
• Experience in cluster management of vendor-based Hadoop and data science products.

Responsibilities

• Provide SME in managing Hadoop and Data Science Platform operations with focus on Cloudera Hadoop, Jupyter Notebook, OpenShift, and Docker-Container Cluster Management and Administration.
• Manage platform operations across all environments including upgrades, bug fixes, deployments, monitoring, disaster recovery, incident management, and capacity planning.
• Integrate solutions with other applications and platforms outside the framework.

Skills

Hadoop

Spark

Kafka

Impala

Hbase

Docker-Container

Ansible

Tools

OpenShift

Job description

Role & responsibilities :

9+ years of exeperience

• Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).
• Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc.
• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker- Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework
• He/she will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident/problem/ capacity management