Senior Scala & Hadoop Big Data Engineer

Tata Consultancy Services Limited; Charlotte (NC); On-site; USD 100,000 - 120,000; Full time

Benefits offered by this job

Discretionary Incentive

Medical Coverage

Parental Leave

Insurance Options

Training Reimbursement

Vacation & Holidays

Legal Assistance

401K Plan

Job summary

Tata Consultancy Services Limited is seeking a Scala Developer with Hadoop in Charlotte, NC. You will design, develop, and maintain large-scale Big Data solutions using Hadoop, Scala, and Spark, building data ingestion pipelines and reusable backend services.

Responsibilities include creating Shell scripts for automation, developing RESTful APIs with Spring Boot, and tuning Spark jobs for batch and real-time processing. Collaboration with DevOps and analysts is essential.

Qualifications

• Minimum 10 years of experience in Big Data and Hadoop ecosystems.
• Proficient in Hadoop, Scala, and Shell scripting.
• Experience with Java and Spring Boot preferred.

Responsibilities

• Design, develop, and maintain large-scale Big Data solutions using Hadoop ecosystem technologies.
• Develop data ingestion, transformation, and processing frameworks with Scala, Spark, and Hadoop.
• Create and maintain Shell scripts for automation, monitoring, deployment, and ops support.
• Build scalable backend services using Java and Spring Boot.
• Develop and optimize Spark applications for batch and real-time data processing.
• Design RESTful APIs and microservices using Spring Boot.
• Work with HDFS, Hive, Sqoop, Kafka, Oozie, and other Hadoop components.
• Perform performance tuning of Hadoop and Spark jobs and troubleshoot production issues.
• Collaborate with business analysts, architects, DevOps, and stakeholders.
• Participate in code reviews, CI/CD, and release activities.
• Ensure compliance with enterprise security, governance, and data quality standards.

Skills

Hadoop

Scala

Shell scripting

Java

Spring Boot

Job description

Tata Consultancy Services Limited is seeking a Scala Developer with Hadoop in Charlotte, NC. You will design, develop, and maintain large-scale Big Data solutions using Hadoop, Scala, and Spark, building data ingestion pipelines and reusable backend services.

Responsibilities include creating Shell scripts for automation, developing RESTful APIs with Spring Boot, and tuning Spark jobs for batch and real-time processing. Collaboration with DevOps and analysts is essential.