Senior Big Data Platform Administrator

Larsen & Toubro Ltd; Chennai; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

Larsen & Toubro Ltd in Chennai, India is seeking a Senior Big Data Platform Administrator to manage enterprise Big Data infra. You will ensure performance, availability, scalability, and security across production and non-production environments.

Ideal candidates have 5–8 years IT experience with 3–5 years hands-on Big Data admin, Hadoop ecosystem, and Linux systems, plus HA/DR, scripting, and DevOps practices to support CI/CD driven deployments.

Qualifications

• Bachelor’s degree in Engineering (BE/B.Tech) in Computer Science or IT.
• 5–8 years overall IT experience with 3–5 years hands-on Big Data platform administration.
• Strong expertise in Hadoop ecosystem and Linux systems.

Responsibilities

• Administer Hadoop ecosystem components (HDFS, YARN) across Production, Test, and Development environments.
• Manage and maintain Apache Spark and Airflow infrastructure.
• Monitor cluster health, troubleshoot performance issues, and optimize system performance.
• Implement and maintain High Availability (HA), Disaster Recovery (DR), backup, and restore strategies.
• Manage logging, monitoring, and alerting systems using Prometheus, Grafana, and ELK Stack.
• Perform Linux (Ubuntu) system administration, including patching, upgrades, and security hardening.
• Develop and maintain automation scripts using Shell and/or Python.
• Handle Kerberos authentication setup and maintenance.
• Support incident management, root cause analysis (RCA), and ensure SLA adherence.
• Manage capacity planning and system scalability.
• Follow CI/CD and DevOps best practices for platform improvements and deployments.

Skills

Hadoop HDFS

YARN

Spark

Airflow

Ubuntu Linux

HA DR

Shell scripting

Python scripting

Kerberos

CI/CD

DevOps practices

Education

BE / B.E. in Computer Science / IT

Tools

Prometheus

Grafana

ELK Stack

Job description

Senior Big Data Administrator Job Title: Senior Big Data Platform Administrator

Location: Chennai, India.

Experience Required: 5–8 years of overall IT experience, with at least 3–5 years of hands‑on experience in Big Data platform administration and Linux systems.

Job Summary We are seeking an experienced Senior Big Data Platform Administrator to manage and support our enterprise Big Data infrastructure. The ideal candidate will have strong expertise in the Hadoop ecosystem, Linux administration, distributed systems, and platform monitoring tools. This role involves ensuring platform performance, availability, scalability, and safety across production and non-production environments.

Key Responsibilities

• Administer and support Hadoop ecosystem components (HDFS, YARN) across Production, Test, and Development environments
• Manage and maintain Apache Spark and Airflow infrastructure
• Monitor cluster health, troubleshoot performance issues, and optimize system performance
• Implement and maintain High Availability (HA), Disaster Recovery (DR), backup, and restore strategies
• Manage logging, monitoring, and alerting systems using Prometheus, Grafana, and ELK Stack
• Perform Linux (Ubuntu) system administration, including patching, upgrades, and security hardening
• Develop and maintain automation scripts using Shell and/or Python
• Handle Kerberos authentication setup and maintenance
• Support incident management, root cause analysis (RCA), and ensure SLA adherence
• Manage capacity planning and system scalability
• Follow CI/CD and DevOps best practices for platform improvements and deployments

Sensitivity: LNT Construction Internal Use

Skills Required Mandatory Skills

• Strong experience with Hadoop ecosystem (HDFS, YARN)
• Hands‑on experience with Apache Spark and Airflow
• Expertise in Linux (Ubuntu) administration
• Experience in implementing High Availability (HA) and Disaster Recovery (DR)

Optional Skills

• Experience with Prometheus, Grafana, and ELK Stack (Elasticsearch, Logstash, Kibana)
• Knowledge of Shell/Python scripting for automation
• Experience with Kerberos authentication
• Strong understanding of distributed systems, cluster management, and performance tuning
• Familiarity with CI/CD pipelines and DevOps practices

Preferred Qualifications

• Experience in managing large‑scale on‑premises Big Data environments
• Certification in Hadoop, Linux, or Cloud/DevOps technologies will be an added advantage

Educational Qualification

• Bachelor’s Degree in Engineering (B.E) – Computer Science / Information Technology

Key Competencies

• Strong problem‑solving and analytical skills
• Excellent troubleshooting and debugging abilities
• Good communication and collaboration skills
• Ability to work in high‑pressure, production‑critical environments
• Proactive and self‑driven mindset

Sensitivity: LNT Construction Internal Use