Senior Big Data Engineer (Hadoop/AWS) | Java

Mapjects.com; Atlanta (GA); Hybrid; USD 110,000 - 170,000; Full time

Job summary

SmartRecruiters, Inc. in the DC-Metro Area is seeking a senior software engineer with Hadoop development experience to join the team building our big data practice.

The role focuses on designing and implementing map-reduce jobs, building Hadoop-centered libraries and UDFs, and evaluating new technologies in the Hadoop ecosystem. A remote option may be available after 6 months, with compensation commensurate to experience.

Qualifications

• Experience with Hadoop-based projects completed successfully.
• Experience with HDFS, MapReduce, HBase, Hive preferred.

Responsibilities

• Design and implement map reduce jobs to support distributed processing using java, hive and hbase
• Build libraries, user defined functions, and frameworks around Hadoop
• Research, evaluate and utilize new technologies/tools/frameworks around hadoop eco system such as MapReduce, HDFS, Hive, HBase, Flume, Mapjects Engine etc.
• Develop user defined functions to provide custom hbase/hive capabilities
• Work with Site-Operations team on upgrades of the cluster
• Participating in the installation, configuration and administration of a single-node and multi-node Hadoop HDFS cluster

Skills

Hadoop development

Java

HDFS

MapReduce

Hive

HBase

Flume

Tools

MapReduce

Job description

SmartRecruiters, Inc. in the DC-Metro Area is seeking a senior software engineer with Hadoop development experience to join the team building our big data practice.

The role focuses on designing and implementing map-reduce jobs, building Hadoop-centered libraries and UDFs, and evaluating new technologies in the Hadoop ecosystem. A remote option may be available after 6 months, with compensation commensurate to experience.