Azure Big Data Architect - Lead Data & Spark Pilot

Next Level Business Services, Inc.; Columbus (IN); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading business services firm is seeking a Big Data Architect with extensive Azure experience. This role requires 10-15+ years in big data solutions, along with capabilities in Hive, Spark, and team leadership. The successful candidate will define ingestion strategies and utilize various data sources, including RDBMS and flat files. A strong background in Unix/Linux and big data technologies is essential for this position.

Qualifications

• 10 - 15+ years of experience in big data solutions.
• Hands-on experience with big data tools and frameworks.
• Ability to define ingestion strategies for data.

Responsibilities

• Lead a team for executing data provisioning.
• Assist in building reusable frameworks.
• Handle evolving schemas and data sources.

Skills

Azure implementation experience

Hands-on with Hive

Knowledge of Spark (Scala)

Ability to lead a team

Knowledge of RDBMS data modeling

Knowledge of ETL tools

Good knowledge of Unix/Linux

Tools

HDFS

Hive

HBase

SPARK

Oozie

Sqoop

Pig

Job description

A leading business services firm is seeking a Big Data Architect with extensive Azure experience. This role requires 10-15+ years in big data solutions, along with capabilities in Hive, Spark, and team leadership. The successful candidate will define ingestion strategies and utilize various data sources, including RDBMS and flat files. A strong background in Unix/Linux and big data technologies is essential for this position.