Hadoop Administrator

hectocorn infotech; Eagan (MN); On-site; USD 90,000 - 120,000; Full time

Job summary

hectocorn infotech is seeking a Senior Hadoop L3 Admin in Eagan, Minnesota. This role involves implementing and maintaining the Hadoop infrastructure while aligning with teams to ensure optimal performance and security of the clusters.

The ideal candidate has comprehensive skills in Hadoop administration, Unix command proficiency, and must be a Green Card holder or Citizen, as sponsorship is not available. Strong collaboration with cross-functional teams is essential to guarantee high data quality and availability.

Qualifications

• Experience as a Cloudera Hadoop L3 Admin with excellent implementation and support skills.
• Strong Unix command and scripting experience.
• Must be GC or Citizen as the client won’t sponsor.

Responsibilities

• Implement and maintain Hadoop infrastructure.
• Propose and deploy new hardware and software environments.
• Set up new Hadoop users and manage log files.
• Perform cluster maintenance and capacity planning.
• Monitor Hadoop cluster connectivity and security.

Skills

Cloudera Hadoop L3 Admin

Unix command and scripting

Tools

Cloudera Manager Enterprise

Ganglia

Nagios

Dell Open Manage

Job description

Senior Hadoop L3 Admin

Must be GC or Citizen as the client won’t sponsor.

Responsibilities

• Responsible for implementation and ongoing administration of Hadoop infrastructure.
• Align with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
• Work with data delivery teams to set up new Hadoop users: Linux users, Kerberos principals, and test HDFS, Hive, Pig and MapReduce access.
• Perform cluster maintenance and creation/removal of nodes using tools such as Ganglia, Nagios, Cloudera Manager Enterprise, Dell Open Manage and others.
• Perform performance tuning of Hadoop clusters and MapReduce routines.
• Screen cluster job performances and conduct capacity planning.
• Monitor Hadoop cluster connectivity and security.
• Manage and review Hadoop log files.
• Manage filesystem and perform monitoring.
• Provide HDFS support and maintenance.
• Collaborate with infrastructure, network, database, application and BI teams to guarantee high data quality and availability.
• Collaborate with application teams to install operating system and Hadoop updates, patches, and version upgrades when required.
• Serve as the point of contact for vendor escalation.
• Design and implement data models based on recognized standards.
• Install and configure software.
• Backup and recover databases.
• Ensure database connectivity and security.
• Monitor and tune performance.
• Apply software patches and upgrades.
• Automate manual tasks.

Qualifications

• Experience as a Cloudera Hadoop L3 Admin with excellent implementation and support skills.
• Strong Unix command and scripting experience.
• Must be GC or Citizen as the client won’t sponsor.

Legal Notice

All your information will be kept confidential according to EEO guidelines.