Senior Hadoop & Spark Engineer (Scala/Java)

Tata Consultancy Services Limited; Charlotte (NC); On-site; USD 100,000 - 120,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Medical Coverage (Health)

Vacation & Holidays

401K Plan & Bonus

Certification & Training Reimbursement

Job summary

Tata Consultancy Services Limited in Charlotte, NC seeks an experienced Hadoop Java Developer to design and maintain large-scale Big Data solutions using Hadoop, Spark, and Scala. You will implement data ingestion, transformation, and backend services with Java and Spring Boot.

The role requires 10+ years in Big Data, strong Unix shells, and a hands-on approach to CI/CD, security, and data quality. You will collaborate with analysts, architects, and DevOps to deliver robust, scalable systems.

Qualifications

• Minimum 10 years of experience in Hadoop/Big Data environments.
• Strong knowledge of Hadoop ecosystem technologies, Spark, and data processing.
• Experience with RESTful APIs, microservices, and Spring Boot.
• Proficient in Shell scripting and data governance basics.

Responsibilities

• Design, develop, and maintain large-scale Big Data solutions with Hadoop ecosystem technologies.
• Develop data ingestion, transformation, and processing frameworks using Spark and Scala.
• Build backend services using Java and Spring Boot.
• Develop and optimize Spark applications for batch and real-time processing.
• Create RESTful APIs and microservices with Spring Boot.
• Work with HDFS, Hive, Sqoop, Kafka, Oozie and other Hadoop components.
• Tune performance of Hadoop and Spark jobs and provide L2/L3 support.
• Collaborate with analysts, architects, DevOps, and stakeholders.
• Participate in code reviews, CI/CD, and release activities.
• Ensure enterprise security, governance, and data quality standards.

Skills

Hadoop

Scala

Shell scripting

Java

Spring Boot

Tools

Kafka

Hive

Sqoop

Oozie

HDFS

Job description

Tata Consultancy Services Limited in Charlotte, NC seeks an experienced Hadoop Java Developer to design and maintain large-scale Big Data solutions using Hadoop, Spark, and Scala. You will implement data ingestion, transformation, and backend services with Java and Spring Boot.

The role requires 10+ years in Big Data, strong Unix shells, and a hands-on approach to CI/CD, security, and data quality. You will collaborate with analysts, architects, and DevOps to deliver robust, scalable systems.