BigData Developer

TechDigital Group; New Jersey; On-site; USD 80,000 - 130,000; Full time

Job summary

An established industry player is seeking a skilled Big Data specialist proficient in Scala and Spark. This exciting role involves leveraging your expertise in the Hadoop ecosystem to drive real-time data processing and analytics. You'll work in a dynamic environment where clear communication and problem-solving skills are essential. If you thrive in challenging situations and are passionate about Big Data technologies, this opportunity is perfect for you to make a significant impact on innovative projects.

Qualifications

• Experience in Big Data technologies and real-time data processing.
• Strong problem-solving and decision-making skills.

Responsibilities

• Work with Linux-based Hadoop ecosystem and demonstrate analytical skills.
• Deliver against agreed objectives while multi-tasking under pressure.

Skills

Spark

Scala

Hive & SQL

Hadoop

Communication

Tools

HDFS

Impala

HBase

Job description

Big Data – Scala/Spark

Must Have Skills:

• Spark
• Scala
• Hive & SQL
• Hadoop
• Communication

Good to have: Banking/Capital Markets Domain

Good Big Data resource with the below Skillset:

• Spark
• Scala
• Hive/HDFS/HQL

• Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.)
• Experience in Big data technologies, real-time data processing platform (Spark Streaming) experience would be an advantage.
• Consistently demonstrates clear and concise written and verbal communication.
• A history of delivering against agreed objectives.
• Ability to multi-task and work under pressure.
• Demonstrated problem-solving and decision-making skills.
• Excellent analytical and process-based skills, i.e. process flow diagrams, business modeling, and functional design.