Big data with Azure architect

Avtech solution; Schaumburg (IL); On-site; USD 120,000 - 190,000; Full time

Job summary

A technology solutions provider is seeking a Big Data Architect with Azure experience in Schaumburg, IL. The role involves hands-on work with Hive, Pig, and Spark to run pilots and develop ingestion strategies. The candidate will lead a small team in executing data provisioning and manage various data sources. Familiarity with RDBMS, SQL, and Unix/Linux is essential. This is an opportunity to drive impactful data solutions and utilize your expertise in big data technologies.

Qualifications

• Hands-on experience with Hive, Pig, and Spark for customer pilots.
• Team leadership for data provisioning from various sources.
• Knowledge of RDBMS data modeling, SQL, and BI tools.
• Strong knowledge of RDBMS data modelling, SQL, and ETL tools.
• Familiarity with NoSQL databases and Big Data technologies.

Responsibilities

• Run pilots and proof of concepts for clients.
• Define ingestion strategies and frameworks.
• Lead a small team for data execution.
• Handle evolving schemas and ensure robust data models.

Skills

Hive

Spark (Scala)

RDBMS

Unix/Linux

NoSQL databases

HDFS

NoSQL

RDBMS

Data modelling

Unix/Linux

Oozie

Sqoop

Education

Any Degree

Tools

HDFS

Oozie

Sqoop

Pig

Job description

Job: Big data + Azure Architect

Location: Schaumburg, IL

Job Description

Big Data Architect with Azure implementation experience. Responsibilities include:

• Hands‑on on Hive, Pig and Spark (Scala) – able to run pilots and PoC for the customer.
• Assist the customer in defining ingestion strategies and reusable frameworks.
• Lead a small team (onsite/offshore) for executing data provisioning – includes mainframe sources, RDBMS, flat files, etc.
• Handle evolving schemas.
• Sound knowledge of RDBMS data modelling, SQL, data warehouse, BI and ETL tools.
• Hands‑on knowledge of Big Data technologies: HDFS, Hive, HBase, Spark, Oozie, Sqoop, Pig.
• Some knowledge of NoSQL databases such as OLAP, graph, key‑value, object XML, JSON, SQL, NOSQL, tuple store, columnar in‑memory.
• Good knowledge of Unix/Linux.

Qualifications

Any Degree.

Additional Information

All your information will be kept confidential according to EEO guidelines.