Azure Architect with Big Data

Avtech solution; Schaumburg (IL); On-site; USD 120,000 - 150,000; Full time

Job summary

A technology solutions company is seeking an Azure Architect and Big Data professional based in Schaumburg, IL. The ideal candidate will have hands-on experience with Hive, Pig, and Spark while leading a team in data provisioning tasks. Candidates should possess good knowledge of RDBMS data modeling, SQL data warehouse, and various Big Data technologies including HDFS, Hive, and SPARK. A degree is required, and knowledge of Unix/Linux is preferred.

Responsibilities

• Handson on Hive, Pig and Spark (Scala) – run pilots and POCs.
• Assist customer in defining ingestion strategies and reusable frameworks.
• Lead a small team for executing data provisioning including mainframe sources.
• Handle evolving schemas and RDBMS data modeling.

Skills

Hands-on on Hive

Spark (Scala)

RDBMS data modeling

SQL data warehouse

ETL tools

Big Data Technologies

Unix/Linux

Education

Any degree

Tools

HDFS

Hive

HBase

SPARK

Oozie

Sqoop

Pig

Job description

Job: Azure Architect and Big Data

Location: Schaumburg, IL

Job Description:

• Handson on Hive, Pig and Spark (Scala) – be able to run pilots and poc for the customer
• Assist the customer in defining the ingestion strategies, reusable frameworks to be built
• Lead a small team (onsite/offshore) for executing the data provisioning – includes mainframe sources, RDBMS, flat files etc.
• Handling evolving schemas
• Sound knowledge of RDBMS data modelling, SQL data warehouse, BI and ETL tools
• Hands‑on knowledge on Big Data Technologies: HDFS, Hive, HBase, SPARK, Oozie, Sqoop, Pig.
• Some knowledge of NoSQL database types such as OLAP, Graph, Key Value, Object XML, JSON, SQL, NOSQL, Tuple Store, Columnar in memory
• Good knowledge of Unix Linux.

Qualifications

Any degree

Additional Information

All your information will be kept confidential according to EEO guidelines.