Spark/Scala Developer

Tata Consultancy Services; Hyderabad; On-site; INR 600,000 - 1,200,000; Full time

Job summary

Tata Consultancy Services in Hyderabad invites experienced Data & Analytics engineer to design, develop, and optimize large-scale data pipelines using Spark and Scala. You will work with Hadoop, Hive, Kafka, and cloud platforms to deliver end-to-end data solutions.

The role emphasizes data quality, performance tuning, and collaboration with data architects, analysts, and business teams to enable AI-ready data ecosystems.

Qualifications

• 4+ years of experience in designing, developing and maintaining data pipelines.
• Proficient with Spark, Hadoop, Hive and Kafka-based data processing.
• Strong SQL knowledge and data warehousing concepts.
• Experience with cloud platforms and ETL/ELT workflows.
• Excellent communication and collaboration skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Spark and Scala for batch and real-time processing.
• Build and optimize ETL/ELT workflows, ensuring data quality, reliability, and performance.
• Work with Hadoop, Hive, Kafka, and cloud platforms to process large-scale data.
• Collaborate with data architects, analysts, and business teams to deliver end-to-end data solutions.
• Monitor, troubleshoot, and tune Spark applications to improve efficiency and stability.

Skills

Apache Spark

Scala Programming

Hadoop Ecosystem

SQL and Data Warehousing

Kafka / Data Ingestion

Unix Shell Scripting

CI/CD and Spark Tuning

Experience 4-10 yrs

Education

Any Technical Degree (BE/BTech / MTech / MCA / BCA / BSc / Diploma / Masters)

15 years of full-time education

Job description

ob DescriptionAbout the Unit: TCS Data & Analytics

is powering the AI revolution by transforming data into a strategic enterprise asset. Built on the philosophy of Smart Data for Smarter AI, it enables organisations to create intelligent, AI-ready ecosystems that accelerate innovation, unlock new value, and drive business transformation at scale. As AI reshapes industries, TCS is helping businesses turn data into their most powerful competitive advantage.

Exp req:4+ Yrs

Venue:

Tata Consultancy Services (TCS)Deccan Park, Plot No. Hitech City Main Road, Software Units LayoutHUDA Techno Enclave, Madhapur Hyderabad, Telangana - 500091

Responsibilities:

• Design, develop, and maintain scalable data pipelines using Spark and Scala for batch and real-time processing.
• Build and optimize ETL/ELT workflows, ensuring data quality, reliability, and performance.
• Work with Hadoop, Hive, Kafka, and cloud platforms to process large-scale structured and unstructured data.
• Collaborate with data architects, analysts, and business teams to deliver end-to-end data solutions.
• Monitor, troubleshoot, and tune Spark applications to improve efficiency, scalability, and operational stability.

Must Have Skills:

• Apache Spark (Core, SQL, Streaming)
• Scala Programming
• Hadoop Ecosystem (HDFS, Hive, HBase)
• SQL & Data Warehousing Concepts
• Kafka / Data Ingestion Frameworks
• Unix / Shell Scripting
• CI/CD, Git, and Performance Tuning of Spark Jobs
• Experience Range: 4 to 10 years
• Qualifications: Any Technical Degree(BE/B,Tech/M.tech/MCA/BCA/BSC/Diploma/Masters)
• 15 years of full-time education.
• Good communication and interpersonal skills
• Strong verbal and written communication skills
• Willingness to work in a collaborative and dynamic environment
• Relevant experience as per the job requirements (if applicable)

Documents required for interview:

• TCS Online Application Form
• Resume
• Govt. Photo ID Proof (Passport / Driving License / Aadhar Card / PAN Card)
• PAN Card
• Marksheet
• Work experience letters

Unit level assets:Solution- can be used as per opening

• TCS Data Modernization Service on AWS

Research insights/Blogs - First 2 articles will go with any AI opening

• Modernise ETL systems for a successful AI-first operating model
• TCS accelerates Alstoms digital transformation with a future-ready Data Integration Backbone

Leadership Video- should go with any Data analytics opening, latest video

• The Future of AI is Built on Data. And It Starts Here- Satish Byravan, Global Head of Data & Analyt…