Hadoop Engineer

Purview Services; Lucknow; On-site; INR 3,500,000 - 5,200,000; Full time

Job summary

Purview Services in Lucknow, India, seeks a senior data platform engineer to lead Hadoop and data science operations across multiple environments. You will own cluster management, deployment, monitoring and capacity planning for enterprise-grade analytics platforms.

The role requires 9+ years of experience with Hadoop ecosystem, Cloudera/Data Science tools, OpenShift and Docker containerization, and a proven track record delivering reliable data services at scale.

Qualifications

• 9+ years of experience in data engineering or platform operations.
• Experience in cluster management of Hadoop and Data Science products.

Responsibilities

• Work on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker-Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework
• Manage platform operations across all environments including upgrades, bug fixes, deployments, metrics/monitoring for resolution and forecasting, disaster recovery, incident/problem/capacity management

Tools

Hadoop

Spark

Kafka

Impala

HBase

Docker-Container

Ansible

OpenShift

Job description

Role & responsibilities :

9+ years of exeperience

• Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).
• Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc.
• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker- Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework
• He/she will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident/problem/ capacity management