Azure Big Data Architect — Spark, Hive & Pipelines

Avtech solution; Schaumburg (IL); On-site; USD 120,000 - 190,000; Full time

Job summary

A technology solutions provider is seeking a Big Data Architect with Azure experience in Schaumburg, IL. The role involves hands-on work with Hive, Pig, and Spark to run pilots and develop ingestion strategies. The candidate will lead a small team in executing data provisioning and manage various data sources. Familiarity with RDBMS, SQL, and Unix/Linux is essential. This is an opportunity to drive impactful data solutions and utilize your expertise in big data technologies.

Qualifications

• Hands-on experience with Hive, Pig, and Spark for customer pilots.
• Team leadership for data provisioning from various sources.
• Knowledge of RDBMS data modeling, SQL, and BI tools.

Responsibilities

• Run pilots and proof of concepts for clients.
• Define ingestion strategies and frameworks.
• Lead a small team for data execution.

Skills

Hive

Spark (Scala)

RDBMS

Unix/Linux

NoSQL databases

Education

Any Degree

Tools

HDFS

Oozie

Sqoop

Pig

Job description

A technology solutions provider is seeking a Big Data Architect with Azure experience in Schaumburg, IL. The role involves hands-on work with Hive, Pig, and Spark to run pilots and develop ingestion strategies. The candidate will lead a small team in executing data provisioning and manage various data sources. Familiarity with RDBMS, SQL, and Unix/Linux is essential. This is an opportunity to drive impactful data solutions and utilize your expertise in big data technologies.