Senior Hadoop/AWS Big Data Engineer for Federal

Mapjects.com; Washington (District of Columbia); On-site; USD 110,000 - 170,000; Full time

Job summary

SmartRecruiters, Inc. is seeking a senior Hadoop/AWS developer for Mapjects.com Federal services to design and implement large-scale data processing pipelines. The role targets cleared engineers capable of delivering in a federal environment and handling on-site data platforms in the VA/DC area.

The candidate will design MapReduce jobs, build Hadoop libraries and UDFs, and evaluate new technologies within the Hadoop ecosystem. Collaboration with operations teams on cluster upgrades is required.

Qualifications

• Experience with Hadoop development in production environments.
• Proficient with HDFS, MapReduce, Hive, and HBase.
• Experience building big data processing jobs.
• US work authorization required or cleared to work in the US.

Responsibilities

• Design and implement map reduce jobs to support distributed processing using Java, Hive and HBase.
• Build libraries, user defined functions, and frameworks around Hadoop.
• Research, evaluate and utilize new technologies/tools/frameworks around Hadoop ecosystem such as MapReduce, HDFS, Hive, HBase, Flume, Mapjects Engine etc.
• Develop user defined functions to provide custom HBase/Hive capabilities.
• Work with Site-Operations team on upgrades of the cluster.
• Participating in the installation, configuration and administration of a single-node and multi-node Hadoop HDFS cluster.

Skills

Hadoop

HDFS

MapReduce

Hive

HBase

Java

Tools

Java

Job description

SmartRecruiters, Inc. is seeking a senior Hadoop/AWS developer for Mapjects.com Federal services to design and implement large-scale data processing pipelines. The role targets cleared engineers capable of delivering in a federal environment and handling on-site data platforms in the VA/DC area.

The candidate will design MapReduce jobs, build Hadoop libraries and UDFs, and evaluate new technologies within the Hadoop ecosystem. Collaboration with operations teams on cluster upgrades is required.