Hadoop developer (Spark, Scala)

Tata Consultancy Services; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tata Consultancy Services is seeking a Hadoop Developer (Spark, Scala) in Bangalore. The role requires 4-8 years of experience in Hadoop ecosystems and hands-on expertise with Spark, Hive, and related tools. Strong debugging and communication skills are essential to deliver scalable data processing solutions.

The candidate should work independently, be familiar with SDLC, and collaborate with client partners to design and implement robust data pipelines.

Qualifications

• 4-8 years of experience in Hadoop development
• Strong debugging and problem-solving skills
• Ability to work independently and with client partners
• Good understanding of SDLC and project lifecycle

Responsibilities

• Understand Hadoop concepts including HDFS, MapReduce, and file systems.
• Hands-on experience with Spark, Hive queries, and writing UDFs in Hive; POCs alone are insufficient.
• Ability to debug and performance-tune large-scale systems; communicate with client partners.
• Work with clients and teams to deliver robust data processing solutions.

Tools

HDFS

Hive

Spark

Sqoop

Flume

Oozie

Unix Script

Autosys

Job description

virtual drive on 31st july 2026

Role : Hadoop developer (Spark, Scala)

location:Bangalore

experience: 4-8 yrs

Responsibility:

• Good understanding of Hadoop concepts including file system and Map Reduce.
• Hands on experience on Spark framework, Unix scripting, Hive queries, wriring UDF in Hive. Theortical knowledge and POC alone will not suffice.
• Good knowledge in Software Development Life Cycle and Project Development Lifecycle.
• Associate should be able to work independently and should have strong debugging skill in both Hive and Spark. Associate should have experience developing large scale systems, experience debugging and performance tuning, excellent software design skills, communication skills and ability to work with client partners.

Technical skills:

• HDFS
• Hive
• Spark
• Sqoop
• Flume
• Oozie
• Unix Script
• Autosys