Senior Hadoop & Spark Big Data Engineer

Jobsbridge; Parsippany-Troy Hills (NJ); On-site; USD 100,000 - 120,000; Full time

Job summary

A growing IT staffing company based in Parsippany-Troy Hills, NJ, is seeking a qualified Java Developer with expertise in Hadoop and a strong understanding of SQL and No-SQL databases. Candidates should have experience in core Java, Hive, Impala, and Pig, with an additional focus on Python and SPARK as advantages. This is a fantastic opportunity to work with cutting-edge technologies in a collaborative environment.

Qualifications

• 6+ years experience in Java.
• 3+ years development skills in Hadoop ecosystem.
• 3+ years experience with Hive/Impala.
• 2+ years experience in Pig.
• 1+ year experience in Python.
• Experience with SPARK and Amazon EMR is a plus.
• Good understanding of compressions and file formats like AVRO & Parquet.
• Sound knowledge of SQL & No-SQL databases.

Responsibilities

• Work with core Java and full-stack Java.
• Develop solutions for Web, Cloud & Mobility.
• Involve in performance/scalability tuning.

Skills

Java

Hadoop

SQL

No-SQL

SPARK

EMR

Hive

Impala

Pig

Python

Tools

Jenkins

Stash

GIT

Job description

A growing IT staffing company based in Parsippany-Troy Hills, NJ, is seeking a qualified Java Developer with expertise in Hadoop and a strong understanding of SQL and No-SQL databases. Candidates should have experience in core Java, Hive, Impala, and Pig, with an additional focus on Python and SPARK as advantages. This is a fantastic opportunity to work with cutting-edge technologies in a collaborative environment.