Aws Data Engineer- Scala with AWS

Tata Consultancy Services; Hyderabad, Chennai District, Bengaluru; On-site; INR 1,500,000 - 2,600,000; Full time

Job summary

Tata Consultancy Services is seeking an AWS Data Engineer to join our data engineering team. The ideal candidate has 6+ years of hands-on experience with big data technologies and cloud platforms, especially AWS, Spark, Hive, Oozie, and Cloudera in enterprise environments.

You will design and optimize data pipelines, implement CI/CD processes, and ensure timely delivery of scalable data solutions. Location options include Chennai, Bangalore, Hyderabad, Kolkatta, and Pune.

Qualifications

• 6+ years of data engineering experience.
• Experience with big data technologies.
• Strong programming skills in Scala/Java/Python.

Skills

Scala

Java

Python

Spark

AWS

Oozie

Hive

Cloudera

CI/CD

Unit testing

Tools

Git

Jenkins

GitLab

Job description

Role: AWS Data Engineer

Exp: 6-10 Years

Location:Chennai, Bangalore, Hyderabad, Kolkatta, Pune

Job Title

AWS Data Engineer

Key Requirements/ Past Experiences/ Knowledge

• Proficiency in Scala/Java/Python
• Oozie, Hive & Scala (hands on)
• Experience with Apache Spark
• Cloud expertise: primarily AWS
• Hands-on experience in building on-premises data pipelines using big data platforms like Cloudera, including basic Hive and Oozie
• Performance tuning techniques - for hive & scala
• CI CD Pipelines (GIT/Jenkins)
• Unit testing
• Familiarity with GitLab for source control

Experience

6+ yrs