Senior Hadoop & Spark Data Engineer (AWS)

Jobsbridge; Newark (NJ); On-site; USD 110,000 - 160,000; Full time

Job summary

A leading IT staffing organization in Newark, NJ is seeking a Full-Time Developer to analyze and prototype data solutions primarily in HiveQL and Spark. The role requires strong experience in the Hadoop ecosystem, UNIX scripting, and the ability to handle large data sets. Responsibilities include developing and unit testing solutions and supporting deployment. Ideal candidates will have comprehensive knowledge of big data technologies, Agile methodologies, and solid programming skills in HiveQL and Java.

Qualifications

• Minimum of 8 years total experience in IT.
• Strong capabilities in HiveQL and UNIX scripting.
• Experience with the Hadoop ecosystem and large data sets.

Responsibilities

• Analyze requirements for data analysis solutions.
• Design, develop, and unit test solutions.
• Facilitate solution deployment and support.

Skills

HiveQL

SQL Development

Map Reduce Performance Tuning

Java Programming

UNIX Shell Scripting

Spark/Scala Programming

AWS Cloud Technologies

Agile Development

Tools

Hadoop

Map Reduce

Job description

A leading IT staffing organization in Newark, NJ is seeking a Full-Time Developer to analyze and prototype data solutions primarily in HiveQL and Spark. The role requires strong experience in the Hadoop ecosystem, UNIX scripting, and the ability to handle large data sets. Responsibilities include developing and unit testing solutions and supporting deployment. Ideal candidates will have comprehensive knowledge of big data technologies, Agile methodologies, and solid programming skills in HiveQL and Java.