Senior Hadoop Data Engineer | Spark, Kafka & Big Data Pipelines

Tech Mirrors; Scottsdale (AZ); On-site; USD 110,000 - 130,000; Full time

Job summary

Tech Mirrors is looking for a Hadoop Data Engineer to design and maintain scalable data processing applications in Scottsdale, AZ. Ideal candidates will have 8-12 years of experience in Java and strong proficiency in Spring Boot, Spark, and Scala.

The role includes building data pipelines and ensuring performance and reliability across large-scale enterprise data platforms. Experience with Hive, Kafka, and RESTful services is essential.

Qualifications

• 8–12 years of hands-on experience in Java (version 8 or above).
• Strong expertise in Spring Boot framework.
• Excellent proficiency in Apache Spark and Scala.

Responsibilities

• Design, develop, and maintain scalable data processing applications using Java and Spring Boot.
• Build and optimize big data pipelines using Spark and Scala.
• Implement and manage batch and streaming data pipelines using Spark Streaming and Kafka.

Skills

Java (version 8 or above)

Spring Boot

Apache Spark

Scala

Hive

SQL optimization

Hadoop

Kafka

RESTful web services

Git/GitLab

Maven/Gradle

Distributed systems

Big data architecture

Spark Streaming

Kafka Streams

Performance tuning

Job description

Tech Mirrors is looking for a Hadoop Data Engineer to design and maintain scalable data processing applications in Scottsdale, AZ. Ideal candidates will have 8-12 years of experience in Java and strong proficiency in Spring Boot, Spark, and Scala.

The role includes building data pipelines and ensuring performance and reliability across large-scale enterprise data platforms. Experience with Hive, Kafka, and RESTful services is essential.