EMR Platform Administrator/ Hadoop Admin

Info Services; Bengaluru; On-site; INR 1,500,000 - 2,200,000; Full time

Job summary

Info Services is seeking a mid-level Platform Administrator for EMR (Hadoop) and Big Data. You will manage day-to-day operations, monitor clusters, and collaborate on automation with senior engineers.

The role emphasizes troubleshooting, performance tuning, and handling production issues in AWS-based Hadoop environments. Offshore location is remote, with international scope and ongoing cloud work.

Qualifications

• Strong hands-on in Linux system administration.
• Experience with AWS EMR and Hadoop ecosystem components.
• Knowledge of HDFS, YARN, Hive and Spark.
• Ability to monitor, troubleshoot and tune large clusters.
• Familiarity with scripting in Shell and Python.

Responsibilities

• Administer and monitor AWS EMR Hadoop clusters.
• Manage Hadoop components: HDFS, YARN, Hive, Spark, MapReduce.
• Perform health checks, job tracking and tuning.
• Assist in cluster setup, scaling, and automation.
• Provide L2/L3 production support and RCA when needed.

Skills

Linux administration

AWS EMR

Hadoop ecosystem

HDFS/YARN

Hive/Spark

Shell/Python

Education

Bachelor's degree in Computer Science / IT

Tools

AWS EMR

Hadoop ecosystem

Zookeeper

Solr

Job description

Job Description: Platform Administrator EMR (Hadoop) & Big Data (4-6 Years)

Experience

Location: Offshore

________________________________________

Role Overview

We are seeking a mid-level Hadoop / EMR Platform Administrator with strong hands‑on experience in managing Big Data platforms. The candidate will focus on day‑to‑day operations, monitoring, troubleshooting, and performance tuning of Hadoop clusters while collaborating with senior engineers on improvements and automation.

________________________________________

Key Responsibilities

Big Data Platform Administration

• Support and administer AWS EMR (Hadoop ecosystem) clusters
• Manage Hadoop components: HDFS, YARN, Hive, Spark, MapReduce
• Perform routine tasks like cluster monitoring, health checks, and job tracking
• Assist in cluster setup, scaling, and performance tuning
• Ensure system availability and data reliability
• Hadoop admins typically handle cluster lifecycle, monitoring, and performance optimization tasks [torchora.com]

________________________________________

AWS & Linux Infrastructure

• Manage Linux systems (RHEL/CentOS/Ubuntu)
• Work with AWS services: EC2, S3, IAM, VPC, CloudWatch
• Perform OS patching, system upgrades, and basic hardening
• Monitor resource utilization and support cost optimization
• AWS admins are responsible for resource provisioning, security, monitoring, and troubleshooting in cloud environments

________________________________________

Distributed Systems & Middleware

• Assist in managing Zookeeper clusters
• Support Solr / search platforms (basic configuration & troubleshooting)
• Troubleshoot common distributed system issues (node failures, latency, data inconsistencies)

________________________________________

Application & Services Management

• Deploy and maintain Apache Tomcat servers
• Support Java application deployments
• Perform basic JVM monitoring and log analysis

________________________________________

Monitoring & Automation

• Use monitoring tools: CloudWatch, Grafana, ELK, Prometheus
• Monitor cluster health and job execution
• Automate repetitive tasks using Shell scripting / Python
• Automation and monitoring are key to maintaining stable and scalable Hadoop environments [torchora.com]

________________________________________

Production Support

• Provide L2 support with occasional L3 contributions
• Troubleshoot failures and perform Root Cause Analysis (RCA)
• Handle tickets, incidents, and service requests
• Work in on‑call rotation
• Hadoop admins are responsible for troubleshooting, system reliability, and operational support [educba.com]

________________________________________

Required Skills & Expertise

Core Skills

• Strong experience in Linux administration
• Hands‑on with AWS EMR and Hadoop ecosystem
• Knowledge of HDFS, YARN, Hive, Spark
• Basic understanding of distributed systems
• Scripting: Shell / Python
• Familiarity with monitoring tools

________________________________________

Big Data Skills

• Understanding of:
• Hadoop architecture
• Data ingestion (Sqoop / Flume - optional exposure)
• Job scheduling and execution
• Hadoop administrators often work with ingestion tools, scheduling, and ecosystem components [velvetjobs.com]

________________________________________

Good to Have

• Exposure to Docker / Kubernetes
• Basic knowledge of CI/CD pipelines
• Familiarity with Terraform / CloudFormation
• Understanding of ETL processes and data pipelines

________________________________________

Soft Skills

• Strong troubleshooting and analytical skills
• Ability to work in production environments under pressure
• Good communication and collaboration skills
• Willingness to learn and grow into senior roles

________________________________________

Preferred Qualifications

• Bachelor's degree in Computer Science / IT
• AWS certification (preferred but not mandatory)
• Exposure to enterprise Big Data platforms