AWS Data Engineer (Python, Pyspark)

Tata Consultancy Services; Hyderabad; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

Tata Consultancy Services in Hyderabad, India invites experienced data engineering professionals to join our big data practice. The role requires hands-on expertise in Scala/Java/Python, Oozie, Hive, Spark, and AWS, with on-prem data pipelines using Cloudera and Hive/Oozie.

You'll design and optimize data processing jobs, implement testing, and contribute to performance tuning and GitLab-based source control.

Qualifications

• Proficiency in Scala/Java/Python.
• Hands-on experience with Oozie/Hive/Scala.
• Experience with Apache Spark.
• Cloud expertise: primarily AWS.
• Hands-on experience building on-prem data pipelines with Cloudera, including Hive/Oozie.
• Performance tuning techniques for Hive/Scala.
• Unit testing.
• Familiarity with GitLab for source control.

Responsibilities

Skills

Scala

Java

Python

Oozie

Hive

Spark

AWS

GitLab

Cloudera

Job description

Come and join us for an exciting career with TCS!!!

Experience: 6 - 8 Years

Required Skills & Qualifications

• Proficiency in Scala/Java/Python
• Oozie, Hive & Scala (hands on)
• Experience with Apache Spark
• Cloud expertise: primarily AWS
• Hands-on experience in building on-premises data pipelines using big data platforms like Cloudera, including basic Hive and Oozie
• Performance tuning techniques - for hive & scala
• Unit testing
• Familiarity with GitLab for source control