Bigdata Developer

Unison Group; Hyderabad; On-site; INR 800,000 - 1,500,000; Full time

Job summary

Unison Group in Hyderabad is seeking a Big Data Support Engineer with strong skills in Hadoop ecosystem technologies. The role includes providing production support, monitoring Big Data platforms, and troubleshooting issues while ensuring compliance with SLAs.

Ideal candidates will have 4-6 years of experience and must possess strong analytical skills. Key technologies required include Hadoop, HDFS, Hive, and Spark, along with a solid understanding of SQL and Unix.

This is a 24/7 rotational shift position.

Qualifications

• 4-6 years of experience in Big Data production support.
• Strong analytical and problem-solving skills.
• Hands-on experience with Hadoop ecosystem technologies.

Responsibilities

• Provide L2/L3 support for Big Data applications and Hadoop clusters.
• Monitor platform health and proactively identify issues.
• Troubleshoot production incidents and perform root cause analysis.

Skills

Spark

Scala

Hive

Hadoop

SQL

Unix

Tools

Kafka

Oozie

Flume

NiFi

Cloudera CDP/CDH

Kubernetes/OpenShift

Job description

• Big Data production support role
• Client: IBM/DBS
• Mode of work: 24/7 Rotational shift (WFO)
• Experience: 4-6 years
• Location: Hyderabad
• N.P: Immediate - 15days
• Required skills: Spark, Scala, Hive, Hadoop, SQL, Unix
• Mode of interview: F2F

Job Summary

We are looking for a Big Data Support Engineer with hands‑on experience in Hadoop ecosystem technologies to provide production support, monitoring, troubleshooting, and performance optimization of Big Data platforms. The candidate should possess strong analytical and problem‑solving skills and be comfortable working in a support environment.

Key Responsibilities

• Provide L2/L3 support for Big Data applications and Hadoop clusters.
• Monitor platform health, analyze logs, and proactively identify issues.
• Troubleshoot production incidents and perform root cause analysis (RCA).
• Support Hadoop ecosystem components such as HDFS, YARN, Hive, Spark, Kafka, Oozie, and Sqoop.
• Manage job failures, performance bottlenecks, and data pipeline issues.
• Work closely with development and infrastructure teams during deployments and releases.
• Perform cluster maintenance, upgrades, patching, and capacity planning.
• Create and maintain operational documentation, runbooks, and SOPs.
• Participate in on‑call support and incident management activities.
• Ensure SLA compliance and timely resolution of support tickets.

Required Skills

• Strong experience with Hadoop ecosystem (HDFS, Hive, Spark, YARN).
• Good knowledge of Kafka, Sqoop, Oozie, Flume, or NiFi.
• Hands‑on experience with Linux/Unix administration.
• Strong SQL and data analysis skills.
• Shell scripting (Bash) and/or Python scripting.
• Experience with log analysis and monitoring tools.
• Knowledge of Cloudera CDP/CDH or Hortonworks platforms.
• Understanding of incident, problem, and change management processes.
• Excellent troubleshooting and communication skills.

Good to Have

• Experience with Kubernetes/OpenShift.
• Knowledge of Airflow, Data Engineering concepts, and ETL pipelines.
• Exposure to cloud platforms (AWS, Azure, GCP).
• Banking or Financial Services domain experience.
• Git and CI/CD knowledge.

Mandatory Skills

Hadoop, HDFS, Hive, Spark, Kafka, Linux, SQL, Shell Scripting, Python, Production Support, RCA, Cloudera/CDP, Incident Management.