Senior Java Spark Engineer - Scalable Data Processing

Tech Mirrors; Berkeley Heights (NJ); Hybrid; USD 120,000 - 150,000; Full time

Job summary

Tech Mirrors is seeking a Java Spark Engineer to design and implement scalable data processing applications in a hybrid setup (Berkeley Heights, NJ). The role emphasizes Core Java, Apache Spark, and Big Data technologies within an Agile environment to deliver enterprise-grade software.

You will develop Spark jobs, build ETL pipelines, and create REST APIs using Spring Boot while participating in code reviews, testing, and performance tuning. Collaboration with cross-functional teams is essential.

Qualifications

• 6+ years of experience in Java development.
• Strong hands-on experience with Core Java (Java 8/11/17).
• Experience with Apache Spark (Spark Core, Spark SQL, DataFrames, RDDs).
• Strong SQL skills and experience with relational databases.
• Knowledge of Hadoop ecosystem (Hive, HDFS) is a plus.
• Experience with Spring Boot and RESTful APIs.
• Familiarity with Kafka or other messaging platforms.
• Experience with Git, Maven, Jenkins, and CI/CD pipelines.
• Knowledge of cloud platforms (AWS, Azure, or GCP) is preferred.
• Strong debugging, performance tuning, and analytical skills.

Responsibilities

• Develop and maintain scalable Java applications using Apache Spark.
• Design and optimize Spark jobs for large-scale data processing.
• Build and enhance ETL/data processing pipelines.
• Develop REST APIs using Spring Boot.
• Perform code reviews, unit testing, and performance optimization.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.
• Troubleshoot production issues and provide timely resolutions.
• Follow Agile/Scrum development methodologies.

Skills

Java development

Core Java (8/11/17)

Apache Spark

SQL

Hadoop ecosystem

Spring Boot

RESTful APIs

Kafka

Git/Maven/Jenkins/CI/CD

Cloud platforms

Tools

Docker

Kubernetes

Microservices

CI/CD

Job description

Tech Mirrors is seeking a Java Spark Engineer to design and implement scalable data processing applications in a hybrid setup (Berkeley Heights, NJ). The role emphasizes Core Java, Apache Spark, and Big Data technologies within an Agile environment to deliver enterprise-grade software.

You will develop Spark jobs, build ETL pipelines, and create REST APIs using Spring Boot while participating in code reviews, testing, and performance tuning. Collaboration with cross-functional teams is essential.