Big Data Developer/ Big Data Engineer

Tata Consultancy Services; Coimbatore District, Bengaluru, Chennai District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tata Consultancy Services is looking for a Big Data Engineer with 8 to 15 years of experience. The ideal candidate should have strong hands-on skills in Hadoop, HIVE, and PySpark, and be familiar with the Big Data ecosystem.

Responsibilities include developing with Cloudera Hadoop, creating PySpark jobs, and working on stream-processing systems like Spark Streaming. Strong SQL skills are essential, and immediate joiners are preferred.

Qualifications

• 8 to 15 years of experience in Big Data technologies.
• Strong hands-on experience with Hadoop, HIVE, Spark, and PySpark.

Responsibilities

• Work on Hadoop, PySpark, Spark SQL, and Big Data Eco System Tools.
• Create PySpark jobs for data transformation and aggregation.
• Experience with stream-processing systems like Spark Streaming.

Skills

Hadoop

HIVE

PySpark

Spark SQL

SQL

Job description

Big Data Engineer

Years of experience: 8 to 15 years

Location: Bangalore, Chennai, Coimbatore

Notice Period: 0 to 30/45/60 days (or) Immediate Joiners are also preferred

Required Skill Set: Hadoop, HIVE, PySpark, Spark SQL

Ex-TCSers are not allowed and experience range less than 8yrs will not be considered

Must Have

• Strong hands‑on experience of Hadoop, HIVE, Spark, PySpark, Big Data Eco System Tools.
• Strong SQL experience.
• Ability to develop, tweak queries and work on performance enhancement.
• Solid understanding of object‑oriented programming and HDFS concepts.

Good To Have

• Preferable to have good DWH/Data Lake knowledge.
• Good DevOps and Agile Development Framework knowledge.

Roles & Responsibilities

• Developer in Cloudera Hadoop.
• Work on Hadoop, PySpark, Spark SQL, Hive, Big data Eco System Tools.
• Provide strong DevOps and Agile Development Framework knowledge.
• Create PySpark jobs for data transformation and aggregation.
• Experience with stream-processing systems like Spark Streaming.