Scala with AWS

Tata Consultancy Services; Hyderabad, Chennai District, Bengaluru; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Tata Consultancy Services is seeking a skilled big data engineer to design, develop, and deploy scalable pipelines using Scala on AWS, with emphasis on Spark and ecosystem tooling. You will build distributed systems with Akka, ensuring robust integration of Spark with Kafka and Hive.

Ideal candidates have 6–8 years of experience and solid cloud-native experience across S3, Lambda, and EMR services in a fast-paced environment.

Qualifications

• 6-8 years of experience in developing big data processing pipelines using Scala on AWS.
• Strong understanding of Spark programming language and its ecosystem (Hadoop, HBase).
• Experience working with cloud-based technologies like AWS S3, Lambda functions, EMR clusters.

Responsibilities

• Design, develop, test, and deploy scalable and highly available big data processing pipelines using Scala on AWS.
• Develop microservices architecture using Akka framework to build distributed systems.
• Ensure seamless integration of Spark applications with other services such as Kafka, Hive, etc.

Skills

Scala

Spark

Akka

AWS

Kafka

Hadoop

HBase

Distributed systems

Tools

AWS S3

Lambda

EMR

Job description

Roles and Responsibilities

• Design, develop, test, and deploy scalable and highly available big data processing pipelines using Scala on AWS.
  
• Develop microservices architecture using Akka framework to build distributed systems.
  
• Ensure seamless integration of Spark applications with other services such as Kafka, Hive, etc.
  

Desired Candidate Profile

• 6-8 years of experience in developing big data processing pipelines using Scala on AWS.
  
• Strong understanding of Spark programming language and its ecosystem (e.g., Hadoop, HBase).
  
• Experience working with cloud-based technologies like AWS S3, Lambda functions, EMR clusters.