Hadoop Administartor

IndSoft Inc; Bridgewater (MA); On-site; USD 100,000 - 130,000; Full time

Job summary

IndSoft Inc is seeking a Hadoop Administrator to manage a large-scale Hadoop cluster environment in Bridgewater, MA. The candidate will participate in building a new Hadoop service offering, requiring strong technical, organizational, and communication skills. Responsibilities include design, deployment, and monitoring of Hadoop platforms, as well as supporting Big Data projects.

The ideal candidate should have 3-4 years of experience in Hadoop support and a deep understanding of the Hadoop ecosystem, including tools like HDFS, MapReduce, and Spark. This role offers an opportunity to work with advanced analytics in a dynamic environment.

Qualifications

• 3-4 years of experience with large scale Hadoop environment build and support.
• Strong understanding of Hadoop ecosystem.
• Experience with disaster recovery and business continuity practices.

Responsibilities

• Design, build, and deploy a new Hadoop platform & service.
• Assist in defining an operation model and best practices.
• Manage and monitor Hadoop cluster and platform infrastructure.

Skills

Hadoop ecosystem knowledge

Cluster setup and management

Performance tuning

Troubleshooting and resolution

UNIX shell scripting

Technical documentation

Tools

HDFS

MapReduce

Cloudera Distribution (CDH)

Spark

AWS

Job description

Job Description

Position: Hadoop Administrator

Location: Bridgewater, NJ

Duration: 6+ months

Client is seeking a Hadoop Administrator to manage large scale Hadoop cluster environment, handling all Hadoop environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring with good technical, organization, and communication skills. This position is located in Bridgewater, NJ site.

As part of the Global Infrastructure Services organization, the Data Management Platforms and Services team is looking for a Hadoop Administrator with a good knowledge of the Hadoop ecosystems to participate in the building of a new Hadoop service offering.

Responsibilities

• Participate in the design, build and deployment of a new Hadoop platform & service to support all Big Data projects, including common service request, monitoring definition, backup and recovery strategy, and security.
• Assist in definition of an operation model and establishing support best practices for Hadoop cluster.
• Participate in POC's with applications and projects interested in Big Data Advanced Analytics, working on enabling/testing solutions and software as needed.
• Work closely with the Regional Service Delivery operation teams to perform training (KT Sessions with L2 and L3), support and optimize Hadoop cluster infrastructure.
• Support development and production deployments as required.
• Manage and monitor Hadoop cluster and platform infrastructure.
• Automate cluster node provisioning and repetitive operational tasks.
• Manage Hadoop stack support runbook in collaboration with the Regional Service Delivery operation teams.

Qualifications

• 3-4 years of experience with large scale Hadoop environment build and support including design, capacity planning, cluster setup, performance tuning and monitoring.
• Strong understanding of Hadoop ecosystem such as HDFS, MapReduce, HBase, Zookeeper, Pig, Sqoop, Oozie and Hive.
• 2-3 years of experience with Cloudera Distribution of Hadoop (CDH).
• Experience with disaster recovery and business continuity practices in Hadoop stack.
• Deep understanding of Hadoop design principals, cluster connectivity, security and performance factors.
• Cloudera Certification CCA 500 preferred.
• Experience with Impala and Spark.
• Experience maintaining, troubleshooting and setting up large clusters.
• Thorough knowledge of current hardware systems commonly used in production environments.
• Ability to proactively identify, troubleshoot and resolve production system issues.
• Technical documentation skill on supported applications and operational tools.
• Strong knowledge in Hadoop monitoring tools.
• Experience with Oracle, SQL, Teradata database platforms is a plus; experience with MongoDB platform is a plus.
• Expertise in UNIX architecture, UNIX tools and UNIX shell scripting.
• Experience with RHEL 5 or 6 Linux.
• Experience with Amazon Cloud (AWS) not mandatory but a huge plus.