Big Data Architect

Saicon Consultants; Des Moines (IA); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading company is seeking a Big Data Architect for a 3-month contract in Des Moines, IA. The role involves architecting solutions using the Hortonworks stack on Azure, processing proprietary XML data, and might collaborate on ETL processes. Ideal candidates have strong expertise in Azure HD Insights and Hadoop-based technologies.

Qualifications

• Experience with Azure HD Insights or Hortonworks on Azure.
• Expertise in using Spark or MapReduce for data processing.
• Ability to expose data for ETL processes.

Responsibilities

• Design and implement architecture for data ingestion and processing.
• Monitor Hadoop listener for new files and manage HDFS.
• Work with client team on optional Informatica integration.

Skills

Azure HD Insights

Hortonworks

Spark

MapReduce

Hive

H-Base

ETL processes

Job description

Here is our client looking for a Big Data Architect in Des Moines, IA for a 3+ months contract.

Requirements: Someone with good Azure HD Insights experience or Hortonworks on Azure experience.

Location: Des Moines, IA

Duration: 10-12 Weeks

Description:

We are seeking a Big Data Architect with expertise in Hortonworks stack on Azure. The stack will be deployed on Azure, involving ingestion and processing of proprietary XML data generated on-premise. Source files are accessed via a shared location, with a Hadoop listener monitoring for new files to push into HDFS. Data processing will be performed using Spark or MapReduce, storing results in Hive or H-Base. Additionally, data will be exposed for ETL processes into an on-premise Data Warehouse, with Informatica connecting to these structures. Note: Informatica development is handled by the client team, so this skill is optional.

Thank you & Regards,

Senior Technical Recruiter

[phone] Ext 160 (W)

[phone] (F)

Email: mkhanATsaiconincDOTcom

SBA 8(a) Certified /WBE/MBE/DBE/SDB

Inc.500 Company – 2006-2010

Ranked #1 "Fastest-Growing Area Businesses" - Kansas City Business Journal - 2006

Ranked in Top 10 of Corporate 100 - Ingram's - 2006 & 2007

ISO 9001:2008 Certified

Additional Information

All your information will be kept confidential according to EEO guidelines.