Aws Data Engineer_Spark & Scala

Tata Consultancy Services; Pune District, Bengaluru, Hyderabad; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Tata Consultancy Services (TCS) invites applications for an AWS Data Engineer. The role requires 6+ years of experience across big data, AWS data services, and Kubernetes on AWS. Primary locations include Chennai, Hyderabad, Pune, Bengaluru, and Delhi.

The ideal candidate will design and implement data ingestion, storage, transformation, and governance pipelines using Hadoop, Spark, Glue, EMR, S3, and related tools, while ensuring robust CI/CD practices with Git/GitHub Actions and Docker.

Qualifications

• Extensive experience with Hadoop ecosystem and Spark.
• Proficient in AWS data services (S3, Glue, EMR) and data governance.
• Hands-on with Kubernetes on AWS and CI/CD pipelines.
• Strong Git and containerization knowledge (Docker).

Skills

Hadoop ecosystem

Spark

Kafka

Python

Scala

Tools

Hadoop

Hive

HDFS

Kubernetes on AWS

AWS (MSK, Kinesis, S3, DynamoDB, Glue, EMR)

Git

Docker

GitHub Actions

Glue

Lake Formation

Job description

Greetings from TCS!!!!

TCS invites application for AWS Data Engineer

Experience Range: 6+ Years

Locations: Chennai, Hyderabad, Pune, Bangalore, Delhi

Notice Period: Less than 60 days

• Extensive experience with big data framework such as Hadoop (Cloudera or any other distribution), the related tooling/systems Hive, HDFS, Spark, Scala etc.
• Extensive experience with AWS services used for data ingestion (MSK, Kinesis, etc.), data storage (S3, DynamoDB, etc.), data transformation (Glue, EMR, etc.), data governance (Lake Formation, Glue Catalog, etc.) & consumption (analytics or operational)
• Key requirement to have good Application Development experience using Kubernetes on AWS
• Good understanding of git-based VCS such us Github, Gitlab, etc
• Good knowledge on Kafka/MSK, whilst proficient in CICD, Github Actions and Docker
• Hands-on in AWS or any relevant certification and programming experience using Scala/Java/Python