Big Data Developer

Tata Consultancy Services; Chennai District; Presencial; INR 1.400.000 - 2.200.000; Jornada completa

Descripción de la vacante

Tata Consultancy Services in Chennai seeks a hands-on Big Data Developer with Java/Scala and Spark experience to design and build scalable data transformation pipelines. You will work with Unix, HDFS, and SQL-family queries while collaborating with distributed teams.

You'll implement CI/CD, write JUnit tests, ensure code quality, and review peers' modules, contributing to high-quality deliverables aligned with business requirements.

Formación

• Hands-on development with Java/Scala and Spark.
• Experience with Unix, HDFS, and SQL-like queries.
• Good communication and customer management skills.

Responsabilidades

• Design high quality deliverables adhering to business requirements and standards.
• Develop and maintain scalable data transformation apps using Apache Spark.
• Develop/integrate code with CI/CD pipelines using Spark in Scala/Java.
• Create JUnit tests and ensure code coverage per standards.
• Review code modules from junior developers and collaborate with distributed teams.

Conocimientos

Communication skills

Customer management

Team collaboration

Herramientas

Java

Scala

Maven

Apache Spark

Spark SQL

Hive SQL

Impala

HBase

Oracle SQL

Unix Shell

HDFS

Junit

CI/CD

Descripción del empleo

• Hands on development experience in programming languages such as JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting
• Should be comfortable with Unix File system as well as HDFS commands
• Should have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DB
• Should be flexible Should have good communication and customer management skills
• Design high quality deliverables adhering to business requirement with defined standards and design principles, patterns
• Develop and maintain highly scalable, high performance Data transformation applications using Apache Spark framework
• Develop/Integrate the code adhering to CI/CD, using Spark Framework in Scala/Java
• Provide solutions to Big data problems dealing with huge volumes of data using Spark based data transformation solutions , Hive, MPP processes like IMPALA.
• Create Junit tests and ensure code coverage is met as per the agreed standards
• Should be able to work with a team who might be geographically distributed. Review the code modules developed by other juniors.