Walk-in | Spark Scala Developer

Tata Consultancy Services; Pune District; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Tata Consultancy Services Pune invites a skilled Spark/Scala Data Engineer to design and maintain big data pipelines using Scala/Java, Apache Spark, Hive, SQL, and Unix shell scripting. You will work with Hadoop ecosystem technologies and collaborate with cross-functional teams.

You will optimize data processing, ensure code quality, and deliver data-driven solutions while supporting production environments and troubleshooting performance issues.

Qualifications

• Experience with Scala/Java, Apache Spark, and Hive.
• Proficient in Unix Shell Scripting and Hadoop ecosystem.
• Strong SQL skills (Hive SQL, Spark SQL, Impala, and HBase) for data pipelines.

Responsibilities

• Develop and maintain big data applications using Scala/Java, Apache Spark, and Hive.
• Design, build, and optimize data processing pipelines.
• Work with HDFS, Unix/Linux file systems, and Shell Scripting.
• Develop and execute queries using Oracle SQL, Hive SQL, Spark SQL, Impala, and HBase.
• Collaborate with business and technical teams to deliver data-driven solutions.
• Ensure code quality, performance optimization, and production support.
• Participate in troubleshooting and performance tuning of big data applications.
• Communicate effectively with customers and stakeholders.

Skills

Scala/Java

Apache Spark

Hive SQL

Unix Shell Scripting

HDFS / Hadoop Ecosystem

Job description

Job Summary

We are looking for a skilled Spark/Scala Data Engineer with strong experience in Scala/Java, Apache Spark, Hive, SQL, and Unix Shell Scripting. The candidate will be responsible for developing and maintaining big data solutions, building scalable data pipelines, and working with Hadoop ecosystem technologies.

Roles & Responsibilities

• Develop and maintain big data applications using Scala/Java, Apache Spark, and Hive.
• Design, build, and optimize data processing pipelines.
• Work with HDFS, Unix/Linux file systems, and Shell Scripting.
• Develop and execute queries using Oracle SQL, Hive SQL, Spark SQL, Impala, and HBase.
• Collaborate with business and technical teams to deliver data-driven solutions.
• Ensure code quality, performance optimization, and production support.
• Participate in troubleshooting and performance tuning of big data applications.
• Communicate effectively with customers and stakeholders.

Must-Have Skills

• Scala / Java
• Apache Spark
• Hive SQL
• Unix Shell Scripting
• HDFS / Hadoop Ecosystem