Bigdata Lead

Jobsbridge; Nashville (TN); On-site; USD 90,000 - 140,000; Full time

Job summary

A leading IT staffing organization in Nashville is looking for a skilled developer with strong expertise in Java and Scala. The ideal candidate will have extensive experience with the Hadoop ecosystem, including Hive, Pig, and MapReduce. Responsibilities include coding, debugging, and automating processes in a dynamic environment using Agile methodologies. If you possess a strong understanding of Hadoop architecture and security management, this opportunity is for you.

Qualifications

• Strong in Java and Scala programming.
• Experience with Unix commands.
• Expertise in Hive, Pig, HDFS, FLUME, SQOOP, and MapReduce.
• Experience in creating Hive UDFs.
• Experience debugging and solving problems in the ecosystem.
• Scripting for automation using Bash scripts.
• Understanding of Hadoop architecture and configurations.
• Experience in Java development projects and Agile methods.

Responsibilities

• Develop and maintain Java/Scala applications in Hadoop ecosystem.
• Work with Hive, Pig, HDFS, Flume, Sqoop, MapReduce to implement data processing solutions.
• Create and optimize Hive UDFs for data transformation.
• Debug and troubleshoot issues across the Hadoop ecosystem.
• Automate repetitive tasks with scripts and macros.

Skills

Java

Scala

Unix commands

Hive

Pig

HDFS

FLUME

SQOOP

MapReduce

Bash scripting

Hadoop Architecture

Kerberos

LDAP/AD integration

Agile methodology

LDAP/AD

Agile

Automation scripting

Job description

Jobs Bridge Inc is among the fastest growing IT staffing / professional services organization with its own job portal. Jobs Bridge works extremely closely with a large number of IT organizations in the most in-demand technology skill sets.

Job Description

Job Description:

Strong in Java , Should be able to code in Scala.

Experience in working with Unix commands.

Expertise working in Hive, Pig, HDFS, FLUME, SQOOP and Map reduce.

Expert in creating hive UDF.

Experience in debugging and solving problems which occurs in Eco system.

Experience scripting for automation (Bash script).

Strong understanding of Hadoop Architecture using Cloudera Manager.

Understanding in Hadoop setup, configuration and management of security for hadoop clusters using Kerberos and integration with LDAP/AD at an Enterprise level.

Experience in Java development project.

Experience working in Agile methodology.

Experience in automation using macro and other possible scripts.