Looking for Java Spark Engineer – Onsite

Tech Mirrors; Berkeley Heights (NJ); Hybrid; USD 120,000 - 150,000; Full time

Job summary

Tech Mirrors is seeking a Java Spark Engineer to design and implement scalable data processing applications in a hybrid setup (Berkeley Heights, NJ). The role emphasizes Core Java, Apache Spark, and Big Data technologies within an Agile environment to deliver enterprise-grade software.

You will develop Spark jobs, build ETL pipelines, and create REST APIs using Spring Boot while participating in code reviews, testing, and performance tuning. Collaboration with cross-functional teams is essential.

Qualifications

• 6+ years of experience in Java development.
• Strong hands-on experience with Core Java (Java 8/11/17).
• Experience with Apache Spark (Spark Core, Spark SQL, DataFrames, RDDs).
• Strong SQL skills and experience with relational databases.
• Knowledge of Hadoop ecosystem (Hive, HDFS) is a plus.
• Experience with Spring Boot and RESTful APIs.
• Familiarity with Kafka or other messaging platforms.
• Experience with Git, Maven, Jenkins, and CI/CD pipelines.
• Knowledge of cloud platforms (AWS, Azure, or GCP) is preferred.
• Strong debugging, performance tuning, and analytical skills.

Responsibilities

• Develop and maintain scalable Java applications using Apache Spark.
• Design and optimize Spark jobs for large-scale data processing.
• Build and enhance ETL/data processing pipelines.
• Develop REST APIs using Spring Boot.
• Perform code reviews, unit testing, and performance optimization.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.
• Troubleshoot production issues and provide timely resolutions.
• Follow Agile/Scrum development methodologies.

Skills

Java development

Core Java (8/11/17)

Apache Spark

SQL

Hadoop ecosystem

Spring Boot

RESTful APIs

Kafka

Git/Maven/Jenkins/CI/CD

Cloud platforms

Tools

Docker

Kubernetes

Microservices

CI/CD

Job description

Job Title: Java Spark Engineer

Location

Berkeley Heights, NJ (Onsite/Hybrid)

Duration

Long Term

Job Description

We are looking for a skilled Java Spark Engineer with experience in building scalable, high-performance data processing applications. The ideal candidate should have strong expertise in Core Java, Apache Spark, and Big Data technologies and be comfortable working in an Agile environment to develop enterprise-grade applications.

Required Skills

• 6+ years of experience in Java development.
• Strong hands-on experience with Core Java (Java 8/11/17).
• Experience with Apache Spark (Spark Core, Spark SQL, DataFrames, RDDs).
• Strong SQL skills and experience with relational databases.
• Knowledge of Hadoop ecosystem (Hive, HDFS) is a plus.
• Experience with Spring Boot and RESTful APIs.
• Familiarity with Kafka or other messaging platforms.
• Experience with Git, Maven, Jenkins, and CI/CD pipelines.
• Knowledge of cloud platforms (AWS, Azure, or GCP) is preferred.
• Strong debugging, performance tuning, and analytical skills.

Responsibilities

• Develop and maintain scalable Java applications using Apache Spark.
• Design and optimize Spark jobs for large-scale data processing.
• Build and enhance ETL/data processing pipelines.
• Develop REST APIs using Spring Boot.
• Perform code reviews, unit testing, and performance optimization.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.
• Troubleshoot production issues and provide timely resolutions.
• Follow Agile/Scrum development methodologies.

Preferred Qualifications

• Experience with financial services or enterprise applications.
• Exposure to Docker, Kubernetes, and Microservices architecture.
• Excellent communication and problem-solving skills.