Hadoop Data Admin

Ventures Unlimited Inc; Schaumburg (IL); On-site; USD 90,000 - 120,000; Full time

Job summary

A dynamic service organization is seeking a Hadoop Data Admin located in Schaumburg, IL. The role involves managing data pipelines, reporting to the Platform Architect, and optimizing data flows in a collaborative environment. Candidates should have over 7 years of IT experience and strong technical skills in JAVA, Hadoop, and data management technologies. The successful applicant will play a key role in enhancing analytics and reporting capabilities.

Qualifications

• 7+ years of total IT experience.
• 4+ years of relevant experience with Hadoop.

Responsibilities

• Manage data pipelines and cross-cluster data flows.
• Report on data management to Platform Architect.
• Collaborate with data scientists to optimize data.

Skills

Data pipeline management

Data management

JAVA

Hadoop ecosystem

HIVE

NOSQL

ETL frameworks

Python

Perl

SQL

Scala

Job description

Ventures Unlimited is a service centric organization. Our success begins with our ability to apply our relationships, leverage technologies, and identify talent - often in combination - to an endless array of real-world customer needs.

Job Description

Title : Hadoop Data Admin
Location : Schaumburg, IL
Type : Full Time Permanent

Job Description

• Responsible for Data pipeline management, cross cluster data flows and data management.
• Responsible for Daily reporting of data management to Platform Architect.
• Interacts with data scientists to enhance and optimize data within the Clusters.
• Strong knowledge in JAVA, Hadoop ecosystem, HIVE and other NOSQL.
• Strong experience in data management for analytics and reporting.
• Expert in handling different formats of data and data structures.
• Recent ecosystem experience with RDBMS(Oracle/Teradata) and data management technologies.
• Experience with large scale DW implementations.
• Clear understanding of data pipelines, data buckets, data management.
• Strong expertise in PIG, Python or Perl scripting.
• Excellent development experience in SQL, NOSQL, Scala, JAVA/Spring on Hadoop.
• Strong design experience with ETL frameworks, data pipeline management with software such as Falcon, JAVA, etc.

Qualifications

• Total IT Experience : 7+ years
• Relevant Experience: 4+ years