Data Architect- Hadoop (9+ Years)

Cloudxtreme; Pune District; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Cloudxtreme is seeking a senior data architect to lead large-scale data initiatives and drive architectural decisions for cutting-edge Hadoop/Hive ecosystems. You will design dimensional models, manage teams, and collaborate with stakeholders to optimize data platforms.

The role requires 8-10+ years of hands-on experience with PySpark, Hadoop, and cloud-based data services, delivering performant data warehouses and lakes.

Qualifications

• Bachelor's degree in CS/IT or related field; Master's preferred.
• 8-10+ years in data modeling, database design, and data architecture with Hadoop/Hive focus.
• Expert HiveQL proficiency and deep Hive architecture understanding.
• Hands-on Hadoop (HDFS, YARN) experience and PySpark for processing.
• Experience in dimensional models, 3NF, Data Vault for large warehouses/lakes.
• Knowledge of Kafka, Spark Streaming, HBase, Impala, or Presto is desirable.
• Familiarity with Parquet/ORC/Avro formats and data partitioning for performance.
• Cloud data platforms (AWS EMR, Azure HDInsight, Google Cloud Dataproc) a plus.
• Strong analytical, problem-solving, and stakeholder communication skills.

Responsibilities

• Lead technical initiatives, manage complex projects, and drive architectural decisions.

Skills

Leadership

Project management

Architectural decisions

Communication

Big data leadership

Education

Bachelor's degree in CS/IT

Master's degree preferred

Tools

HiveQL

Hadoop

HDFS

YARN

PySpark

Kafka

Spark Streaming

HBase

Presto

Parquet

ORC

Avro

AWS EMR

Azure HDInsight

Google Cloud Dataproc

Job description

Role & responsibilities

• Proven ability to lead technical initiatives, manage complex projects, and drive architectural decisions.

Qualifications

• Bachelor's degree in computer science, Information Technology, or a related quantitative field. Master's degree preferred.
• 8-10+ years of hands-on experiencein data modeling, database design, and data architecture, with aprimary focus on Hadoop/Hive ecosystems and big data technologies.
• Expert-levelproficiencyin HiveQLand deep understanding of Hivearchitecture.
• Strong hands-on experience with Apache Hadoop(HDFS, YARN) and related components.
• MandatoryproficiencyinPySparkfor data processing, transformation, and optimization.
• Demonstrable experience in designing and implementing dimensional models, 3NF, Data Vault, or other relevant data modeling techniques for large-scale data warehouses/lakes.
• Experience with other big data technologies such as Kafka, Spark Streaming, HBase, Impala, or Presto is highly desirable.
• Strong understanding of data partitioning, bucketing, and file formats (Parquet, ORC, Avro) within Hadoop for performance optimization.
• Familiarity with cloud-based big data platforms (e.g., AWS EMR, Azure HDInsight, Google CloudDataproc) is a significant plus.
• Excellent analytical, problem-solving, and communication skills, with the ability to articulate complex technical concepts to non-technical stakeholders.