Scala Developer

Tata Consultancy Services Limited; Chennai; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Tata Consultancy Services Limited is seeking an Apache Spark & Scala Developer in Chennai. The role requires 4–8 years of hands-on experience with Scala, Spark, and distributed data processing.

You will design, build, and optimize data pipelines, work across batch and real-time processing, and collaborate with cross-functional teams to meet data objectives. Strong knowledge of Hive, HDFS, Kafka, and Hadoop ecosystem, plus SQL, Unix/Linux scripting, and CI/CD practices, will be valued for

Qualifications

• Hands-on experience in building scalable data processing applications.
• Strong expertise in Scala programming and Apache Spark.
• Good understanding of distributed computing concepts.

Responsibilities

• Design, develop, and maintain large-scale data processing applications using Apache Spark and Scala.
• Build and optimize batch and real-time data pipelines.
• Perform data transformation, cleansing, and integration from multiple data sources.
• Develop reusable, scalable Spark applications and monitor job performance.
• Collaborate with data engineers, architects, and business teams to gather requirements.
• Optimize Spark workloads, memory usage, and cluster performance.

Skills

Scala programming

Apache Spark

Distributed computing

SQL

Unix/Linux

ETL processes

Git

CI/CD

Tools

Hive

HDFS

Kafka

Hadoop

Job description

Hiring: Apache Spark & Scala Developer

Location: Chennai ,

Experience:4-8Years

Interview Mode: Virtual

Interview Date:To Be Announced

Job Summary

We are looking for a skilled Apache Spark & Scala Developer with hands-on experience in building scalable data processing applications and big data solutions. The ideal candidate should have expertise in Scala programming, Apache Spark, and distributed data processing frameworks, with the ability to develop and optimize high-performance data pipelines.

Ideal Candidate

• Strong experience in Scala programming.
• Hands-on experience with Apache Spark (Core, SQL, DataFrames, Spark Streaming).
• Good understanding of distributed computing concepts.
• Experience working with Hive, HDFS, Kafka, or Hadoop ecosystem.
• Knowledge of SQL and data modeling concepts.
• Experience with Unix/Linux environments and shell scripting.
• Understanding of ETL processes and data warehousing concepts.
• Familiarity with Git and CI/CD processes.

Key Responsibilities

• Design, develop, and maintain large-scale data processing applications using Apache Spark and Scala.
• Build and optimize batch and real-time data pipelines.
• Perform data transformation, cleansing, and integration from multiple data sources.
• Develop reusable, scalable, and efficient Spark applications.
• Monitor and troubleshoot Spark jobs to ensure performance and reliability.
• Collaborate with data engineers, architects, and business teams to understand requirements.
• Optimize Spark workloads, memory usage, and cluster performance.
• Ensure adherence to coding standards, best practices, and security guidelines.