AWS Data Engineer

Tata Consultancy Services; Tamil Nadu; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tata Consultancy Services in Chennai is seeking an experienced AWS Data Engineer to design and implement scalable data pipelines. You will work with big data technologies to collect, store, and analyze large volumes of information.

Qualifications include 5–10 years of hands-on experience with Spark, Hadoop, Hive, and cloud services such as AWS. Strong programming in Python/Java and data visualization skills are valued.

Qualifications

• Design data collection and visualization strategies across sources.
• Develop big data solution recommendations and ensure implementation.
• Program in Scala, Python, Java, Pig or SQL.
• Proficient with Spark, MapReduce, and Hadoop ecosystems.
• Understanding of Hadoop, Hive, HBase, MongoDB and/or MapReduce.
• Experience with AWS or Elastic MapReduce (EMR).
• Tune Spark engine for high-volume data processing.
• Troubleshoot data issues with root-cause analysis.

Responsibilities

• Should be able to design strategies and programs to collect, store, analyse and visualize data from various sources.
• Should be able to develop big data solution recommendations and ensure implementation of the chosen big data solution.
• Needs to be able to program, preferably in different programming/scripting languages such as Scala, Python, Java, Pig or SQL.
• Proficient knowledge in Big data frameworks Spark, Map Reduce.
• Should have an understanding of Hadoop, Hive, HBase, MongoDB and/or MapReduce.
• Experience with one of the cloud infra like AWS or EMR.
• Tuning the Spark Engine for high data volumes.
• Troubleshoot data issues and perform root-cause analysis.

Skills

Big data

Spark

Hadoop

AWS

Python

Java

SQL

Tools

Hive

HBase

MongoDB

MapReduce

Pig

EMR

Job description

Interview Mode : Weekend Walkin drive (Face to Face )

Interview Date : 29-Aug-26(Saturday )

Note : Only candidates currently located in Chennai should apply.

Role : AWS Data Engineer

Experience : 5 to 10 Years

Location : chennai

Desired Competencies (Technical/Behavioral Competency)

Must-Have:

Key responsibilities (please specify if the position is an individual one or part of a team):

1) Should be able to design strategies and programs to collect, store, analyse and visualize data from various sources.

2) Should be able to develop big data solution recommendations and ensure implementation of the chosen big data solution.

3) Needs to be able to program, preferably in different programming/scripting languages such as Scala, Python, Java, Pig or SQL.

4) Proficient knowledge in Big data frameworks Spark, Map Reduce,

5) Should have an understanding of Hadoop, Hive, HBase, MongoDB and/or MapReduce.

6) Should also have experience with one of the large cloud-computing infrastructure solutions like Amazon Web Services or Elastic MapReduce.

7) Tuning the Spark Engine for high volume of data ( approx billion records) processing using BDM.

8) Troubleshoot data issues, deep dive into root cause analysis of any performance issue.