Lead Data Modeler OR Big Data Architect OR Senior Data Engineer

Cloudxtreme; Pune District, Bengaluru, Delhi; On-site; INR 3,500,000 - 5,500,000; Full time

Job summary

Cloudxtreme in Pune, India is seeking an experienced Senior Data Engineer to design and optimize large-scale data architectures using Hadoop/Hive, PySpark, and cloud data platforms. You will shape data models, drive performance improvements, and collaborate with analytics and engineering teams.

The ideal candidate has 8–10+ years of hands-on experience in data modeling, database design, and big data ecosystems, with proven leadership on complex projects and strong communication skills.

Qualifications

• Bachelor's degree in computer science, information technology, or related quantitative field.
• 8-10+ years in data modeling, database design, and data architecture.
• Expert-level HiveQL and deep Hive architecture understanding.
• Hands-on experience with Apache Hadoop (HDFS, YARN).
• Proficiency in PySpark for data processing and optimization.
• Designing dimensional models, 3NF, Data Vault for large warehouses.
• Experience with Kafka, Spark Streaming, HBase, Impala, or Presto is desirable.
• Strong knowledge of partitioning, bucketing, and Parquet/ORC/Avro formats.
• Familiarity with cloud big data platforms (AWS EMR, Azure HDInsight, GCP Dataproc).
• Excellent analytical, problem-solving, and communication skills.
• Proven ability to lead technical initiatives and drive architecture.

Skills

Data modeling

Database design

Data architecture

HiveQL

Hadoop

PySpark

Big data

Leadership

Education

Bachelor's degree in CS/IT or related field

Master's degree preferred

Tools

HDFS

YARN

Hive architecture

Kafka

Spark Streaming

HBase

Impala

Presto

Parquet

ORC

Avro

Cloud platforms (AWS EMR, Azure HDInsight, GCP Dataproc)

Job description

Role & responsibilities

Qualifications

• Bachelor's degree in computer science, Information Technology, or a related quantitative field. Master's degree preferred.
• 8-10+ years of hands-on experience in data modeling, database design, and data architecture, with a primary focus on Hadoop/Hive ecosystems and big data technologies.
• Expert-level proficiency in HiveQL and deep understanding of Hive architecture.
• Strong hands-on experience with Apache Hadoop (HDFS, YARN) and related components.
• Mandatory proficiency in PySpark for data processing, transformation, and optimization.
• Demonstrable experience in designing and implementing dimensional models, 3NF, Data Vault, or other relevant data modeling techniques for large-scale data warehouses/lakes.
• Experience with other big data technologies such as Kafka, Spark Streaming, HBase, Impala, or Presto is highly desirable.
• Strong understanding of data partitioning, bucketing, and file formats (Parquet, ORC, Avro) within Hadoop for performance optimization.
  Familiarity with cloud-based big data platforms (e.g., AWS EMR, Azure HDInsight, Google Cloud Dataproc) is a significant plus.
• Excellent analytical, problem-solving, and communication skills, with the ability to articulate complex technical concepts to non-technical stakeholders.
• Proven ability to lead technical initiatives, manage complex projects, and drive architectural decisions.