BigData Engineer- Spark,Scala

Tata Consultancy Services; Chennai District, Pune District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tata Consultancy Services is seeking a skilled Big Data Developer in Chennai with hands-on experience in Java and Scala, Maven, and Apache Spark. The role emphasizes working with Spark SQL, Hive, and HDFS, plus strong communication and customer management abilities.

Ideal candidates will be adaptable and able to handle various data processing tasks, including exposure to big data ingestion tools like SQOOP and Kafka, within a dynamic project environment.

Qualifications

• Hands-on development experience in Java and Scala using Maven and Spark Frameworks.
• Unix shell scripting and Unix file system with HDFS commands.
• Proficient in Oracle SQL, Hive SQL, Spark SQL, Impala and HBase.
• Flexible in approach and strong communication and customer management skills.

Skills

Java

Scala

Maven

Apache Spark

Unix Shell scripting

Unix File system

HDFS commands

Oracle SQL

Hive SQL

Spark SQL

Impala

HBase

Communication skills

Customer management

Tools

SQOOP

Kafka

Eclipse IDE

Tectia Client

Oracle SQL Developer

Job description

Must-Have

• Hands on development experience in programming languages such as JAVA, SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting
• Comfortable with Unix File system as well as HDFS commands
• Experience with query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DB
• Flexible in approach
• Good communication and customer management skills

Good-to-Have

• Knowledge of big data ingestion tools such as SQOOP and KAFKA
• Aware of components in the big data ecosystem
• Experience building projects using Eclipse IDE, Tectia Client, Oracle SQL Developer