Aws Data Engineer _ J

Tata Consultancy Services; Hyderabad, Pune District, Bengaluru; On-site; INR 1,400,000 - 2,300,000; Full time

Job summary

Tata Consultancy Services in Hyderabad, India seeks an AWS Data Engineer to design and implement scalable data pipelines using Spark, Hive and Oozie in a cloud-led environment.

The role requires hands-on expertise with AWS, on-premise Cloudera pipelines, and CI/CD practices with GitLab and Jenkins. You will collaborate with cross-functional teams to optimize data workflows and deliver reliable data processing solutions.

Qualifications

• Proficiency in Scala/Java/Python required.
• Hands-on experience with Oozie, Hive and Spark.
• Cloud expertise with AWS and on-prem data pipelines with Cloudera.
• Familiar with GitLab for source control and CI/CD pipelines.

Skills

Scala/Java/Python

AWS

CI/CD pipelines

Unit testing

Cloudera data pipelines

Tools

Oozie

Hive

Apache Spark

GitLab

Jenkins

Job description

Job Title

AWS Data Engineer

Key Requirements/ Past Experiences/ Knowledge

• Proficiency in Scala/Java/Python
• Oozie, Hive & Scala (hands on)
• Experience with Apache Spark
• Cloud expertise: primarily AWS
• Hands-on experience in building on-premises data pipelines using big data platforms like Cloudera, including basic Hive and Oozie
• Performance tuning techniques - for hive & scala
• CI CD Pipelines (GIT/Jenkins)
• Unit testing
• Familiarity with GitLab for source control

Location

Hyderabad, Bangalore, Kolkata, Chennai

.