Hadoop Engineer

Purview Services; Faridabad District; On-site; INR 4,500,000 - 6,500,000; Full time

Job summary

Purview Services in India seeks a Senior Big Data Engineer to lead complex data platform operations. You will manage Hadoop and data science platform operations, handling upgrades, deployments, monitoring and capacity planning across environments.

The role requires 9+ years of experience with Hadoop, Spark, Kafka and related tools, plus strong cluster-management skills using OpenShift, Docker containers and Jupyter Notebook. On-site role with collaboration across teams.

Qualifications

• 9+ years of experience in big data technologies.
• Experience in cluster management of vendor-based Hadoop and Data Science products.
• Platform operations including upgrades, deployments, monitoring, capacity management.

Responsibilities

• Big Data Technologies (Hadoop, Spark, Kafka, Impala, HBase, Docker-Container, Ansible).
• Manage cluster operations and administration for Hadoop and data science platforms."
• Integrates solutions with other applications and platforms as needed.
• Lead platform operations across environments including upgrades, monitoring, disaster recovery and capacity planning.

Skills

Hadoop

Spark

Kafka

Impala

HBase

Docker-Container

Ansible

Cluster management

Job description

Role & responsibilities :

9+ years of exeperience

• Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).
• Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc.
• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker- Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework
• He/she will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident/problem/ capacity management