Azure Big Data Architect — Lead Pipelines & POCs

Avtech solution; Schaumburg (IL); On-site; USD 120,000 - 150,000; Full time

Job summary

A technology solutions company is seeking an Azure Architect and Big Data professional based in Schaumburg, IL. The ideal candidate will have hands-on experience with Hive, Pig, and Spark while leading a team in data provisioning tasks. Candidates should possess good knowledge of RDBMS data modeling, SQL data warehouse, and various Big Data technologies including HDFS, Hive, and SPARK. A degree is required, and knowledge of Unix/Linux is preferred.

Responsibilities

• Handson on Hive, Pig and Spark (Scala) – run pilots and POCs.
• Assist customer in defining ingestion strategies and reusable frameworks.
• Lead a small team for executing data provisioning including mainframe sources.
• Handle evolving schemas and RDBMS data modeling.

Skills

Hands-on on Hive

Spark (Scala)

RDBMS data modeling

SQL data warehouse

ETL tools

Big Data Technologies

Unix/Linux

Education

Any degree

Tools

HDFS

Hive

HBase

SPARK

Oozie

Sqoop

Pig

Job description

A technology solutions company is seeking an Azure Architect and Big Data professional based in Schaumburg, IL. The ideal candidate will have hands-on experience with Hive, Pig, and Spark while leading a team in data provisioning tasks. Candidates should possess good knowledge of RDBMS data modeling, SQL data warehouse, and various Big Data technologies including HDFS, Hive, and SPARK. A degree is required, and knowledge of Unix/Linux is preferred.