Walk-in | Hadoop/Bigdata developer

Tata Consultancy Services; Chennai District; On-site; INR 900,000 - 1,200,000; Full time

Job summary

Tata Consultancy Services is seeking a skilled professional in Chennai for data processing and analytics using Hadoop and Spark. The role involves requirements gathering, designing data processing frameworks, and collaborating with the team to meet deadlines.

Candidates should have hands-on Spark, Hive, and Hadoop experience, plus SDLC knowledge and strong debugging abilities. This position is based in Chennai, India.

Qualifications

• Understanding of Hadoop concepts including file system and Map Reduce.
• Hands on experience on Spark framework, Unix scripting, Hive queries, writing UDF in Hive.
• Knowledge of SDLC and project development lifecycle.
• Ability to work independently and debug Hive and Spark.

Responsibilities

• Collaborate with senior team members to Requirements Gathering and design.
• Assist in the development and implementation of Creating data processing framework based on Spark with Java.
• Work with other team members to ensure project deadlines are met.
• Conduct research and development to improve [Insert Relevant Processes or Technologies].

Skills

Hadoop concepts

Hive queries

UDF development

SDLC knowledge

Independent work

Tools

Spark framework

Unix scripting

Hive UDF

POC/Prototyping

Job description

Key Responsibilities

• Collaborate with senior team members to Requirements Gathering and design.
• Assist in the development and implementation of Creating data processing framework based on Spark with Java.
• Work with other team members to ensure project deadlines are met.
• Conduct research and development to improve [Insert Relevant Processes or Technologies].

Must Have skills

• Good understanding of Hadoop concepts including file system and Map Reduce.
• Hands on experience on Spark framework, Unix scripting, Hive queries, writing UDF in Hive. Theoretical knowledge and POC alone will not suffice.
• Good knowledge in Software Development Life Cycle and Project Development Lifecycle.
• Associate should be able to work independently and should have strong debugging skill in both Hive and Spark.