Big data Architect with Horton works Experience

Avtech solution; Hartford (CT); On-site; USD 110,000 - 150,000; Full time

Job summary

A technology solutions provider is seeking a Big Data Architect in Hartford, CT, to lead the architecture of an HDP data lake. The ideal candidate will have hands-on experience with Hive, Pig, and Spark (Scala) while being capable of defining data ingestion patterns and leading a small team. The role entails assisting clients with data lake strategies and frameworks, ensuring efficient data provisioning from various sources. Join a dynamic team leveraging cutting-edge data technologies for impactful solutions.

Qualifications

• Experience with HDP data lake architecture.
• Hands-on skills with Hive, Pig, and Spark (Scala).
• Ability to define ingestion strategies.

Responsibilities

• Lead a small team for data provisioning.
• Define data lake ingestion patterns.
• Assist customers in building the data lake.

Job description

Big data Architect with Horton works Experience

• Contract

Job Title: Big data Architect with Horton works Experience

Location: Hartford, CT

Job description:

• Solution Architecture of the HDP data lake
• Defining the Data Lake Ingestion patterns
• Hands on Hive, Pig and Spark (Scala) – be able to run pilots and poc for the customer
• Work with Hortonworks team in scoping out the data lake work
• Assist the customer in defining the Ingestion strategies, reusable frameworks to be built
• Lead a small team ( onsite/offshore) for executing the data provisioning – Includes Main frame sources, RDBMS, flat files etc.
• Help the customer with consulting on how the data lake will be built
• Handling evolving schemas

Any Degree

All your information will be kept confidential according to EEO guidelines.