Senior Oracle Administrator - Oracle Administration,PostgreSQL,MYSQL, MS SQL

HCLTech; Pandhurna; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

HCL Technologies Limited is seeking an experienced Big Data Platform Engineer to lead and operate large-scale Hadoop and Spark ecosystems for banking workloads. You will deploy, configure, and upgrade clusters, set up YARN/HDFS/Hive/Spark, and optimize performance while ensuring security and compliance across on-prem and cloud environments.

You will mentor junior admins, build monitoring dashboards, and drive continuous improvement through automation, cost optimization, and newer data ops

Qualifications

• 8+ years of hands on experience operating large scale Hadoop/Spark ecosystems (≥ 10 PB total storage).
• 3+ years in a lead or supervisory role (team of 3-8 DBAs/Admins).
• Prior experience in a banking or financial services environment is mandatory.
• Deep knowledge of HDFS, YARN, MapReduce, Hive/Impala, Spark (standalone/YARN), HBase, ZooKeeper, Kafka, Oozie/Airflow.
• Proficiency with Linux/Unix (RHEL/CentOS) administration, shell scripting, and Python/Perl.
• Experience with Cloudera Manager / Hortonworks Ambari (or equivalent) for cluster lifecycle management.
• Strong grasp of Kerberos, SSL/TLS, Apache Ranger/Sentry, Apache Knox for security.
• Familiarity with cloud based big data services (AWS EMR, Azure HDInsight, Google Dataproc) and hybrid cloud integrations.
• Working knowledge of data ingestion tools (Sqoop, Flume, NiFi), data movement (DistCp), and metadata/lineage (Apache Atlas, Cloudera Navigator).
• Cloudera Certified Administrator (CCA Spark/Hadoop) - required.
• Hortonworks Certified Apache Hadoop Administrator (HCAH) - preferred.
• AWS Certified Big Data - Specialty or Azure Data Engineer Associate - optional.
• ITIL Foundation - preferred.

Responsibilities

• Deploy, configure, and upgrade Hadoop distributions.
• Set up YARN, HDFS, Hive, Spark, HBase, ZooKeeper, Kafka, Oozie/Airflow, and related services.
• Implement multi tenant resource pools and quota management.
• Build and maintain monitoring dashboards for capacity, health, latency, and job failure alerts.
• Perform daily health checks, log analysis, and trend based capacity planning.
• Optimise Hadoop cluster parameters and query tuning for banking workloads.
• Enforce authentication and authorization, data in motion and at rest encryption, and audit logging.
• Work with security team for audit requirements.
• Define and test backup strategies and manage DR replication.
• Develop scripts and automation for provisioning, patching, and data ingestion pipelines.
• Mentor junior admins and lead Big Data Ops workshops.
• Identify opportunities for cost optimization and evaluate emerging technologies.

Skills

Hadoop/Spark ops

Team lead

Banking domain

Linux scripting

Python/Perl

Security basics

Education

Bachelor's degree in CS/IS/EE

Master's degree preferred

Tools

Cloudera Manager

Ambari

AWS EMR

Azure HDInsight

Google Dataproc

Sqoop

Flume

NiFi

Job description

Requisition ID187257-Posted11/04/2026

Platform Installation & Configuration

• Deploy, configure, and upgrade Hadoop distributions (Cloudera CDH, Hortonworks/DataPlane, or Cloud native equivalents).
• Set up YARN, HDFS, Hive, Spark, HBase, ZooKeeper, Kafka, Oozie/Airflow, and related services.
• Implement multi tenant resource pools and quota management.

Operations & Monitoring

• Build and maintain monitoring dashboards (Cloudera Manager, Ambari, Grafana, Prometheus) for capacity, health, latency, and job failure alerts.
• Perform daily health checks, log analysis, and trend based capacity planning.

Performance Tuning

• Optimise Hadoop cluster parameters (block size, replication factor, YARN scheduler, Spark executor settings).
• Tune Hive/Impala queries, Spark jobs, and HBase schema for banking workloads (transaction level reporting, fraud detection).

Security & Compliance

• Enforce authentication (Kerberos) and authorisation (Apache Ranger, Sentry).
• Implement data in motion encryption (TLS), at rest encryption (HDFS transparent encryption), and audit logging.
• Work with the Information Security team to satisfy PDPL, C Bank, and ISO 27001 audit requirements.

Backup, Recovery & DR

• Define and test backup strategies (DistCp, snapshots, cloud based tiering).
• Manage disaster recovery (DR) replication (Cloudera Replicated HDFS, MirrorMaker for Kafka).

Automation & Scripting

• Develop reusable scripts (Bash, Python, PowerShell) or Ansible/Chef/Puppet playbooks for provisioning, patching, and routine maintenance.
• Automate data ingestion pipelines (Sqoop, Flume, NiFi) and job orchestration (Oozie/Airflow).

Incident Management

• Serve as Tier 2/Tier 3 escalation point for big data incidents; own end to end resolution and RCA documentation.
• Communicate impact, mitigation steps, and ETA to stakeholders via ServiceNow and the DR Slack channel.

Collaboration & Stakeholder Management

• Partner with data engineering, data science, and business intelligence teams to provision environments, grant access, and resolve performance issues.
• Liaise with vendors (Cloudera, Hortonworks, AWS, Azure) for support tickets, licensing, and POCs.

Team Leadership & Knowledge Sharing

• Mentor junior administrators; conduct internal \"Big Data Ops\" workshops and maintain run books on the secured SharePoint library.
• Contribute to the Data Platform community of practice (code reviews, best practice documentation).

Continuous Improvement

• Identify opportunities for cost optimization (e.g., spot instance usage, tiered storage).
• Evaluate emerging technologies (Kubernetes based data ops, Delta Lake, Lakehouse architecture) and propose proof of concepts.

Skill Requirements

• 8 + years of hands on experience operating large scale Hadoop/Spark ecosystems (≥ 10 PB total storage).
• 3 + years in a lead or supervisory role (team of 3 8 DBAs/Admins).
• Prior experience in a banking or financial services environment is mandatory.
• Deep knowledge of HDFS, YARN, MapReduce, Hive/Impala, Spark (standalone/YARN), HBase, ZooKeeper, Kafka, Oozie/Airflow.
• Proficiency with Linux/Unix (RHEL/CentOS) administration, shell scripting, and Python/Perl.
• Experience with Cloudera Manager / Hortonworks Ambari (or equivalent) for cluster lifecycle management.
• Strong grasp of Kerberos, SSL/TLS, Apache Ranger/Sentry, Apache Knox for security.
• Familiarity with cloud based big data services (AWS EMR, Azure HDInsight, Google Dataproc) and hybrid cloud integrations.
• Working knowledge of data ingestion tools (Sqoop, Flume, NiFi), data movement (DistCp), and metadata/lineage (Apache Atlas, Cloudera Navigator).
• Cloudera Certified Administrator (CCA Spark/Hadoop) - required.
• Hortonworks Certified Apache Hadoop Administrator (HCAH) - preferred.
• AWS Certified Big Data - Specialty or Azure Data Engineer Associate - optional.
• ITIL Foundation - preferred.

Other Requirements

Education Bachelor's degree in Computer Science, Information Systems, Electrical Engineering, or related field. (Master's degree preferred)

Experience

• 8 + years of hands on experience operating large scale Hadoop/Spark ecosystems (≥ 10 PB total storage).
• 3 + years in a lead or supervisory role (team of 3 8 DBAs/Admins).
• Prior experience in a banking or financial services environment is mandatory.