Principal Data Architect

HireAlpha; Bengaluru; On-site; INR 4,500,000 - 7,000,000; Full time

Job summary

HireAlpha in Bengaluru is seeking a Senior Data Architect to design and implement enterprise-scale data platforms. You will define data models, data integration strategies, and governance frameworks while architecting Data Lakehouse solutions with Databricks.

Collaborate with business stakeholders and engineering teams to translate requirements into robust technical solutions. Establish best practices for security, quality, scalability, and performance; design ETL/ELT pipelines with

Qualifications

• 8+ years of experience in Data Engineering/Data Architecture.
• Expertise with Databricks, Delta Lake, Unity Catalog, and Lakehouse Architecture.
• Strong knowledge of Spark, PySpark, SQL, and distributed data processing.
• Experience designing large-scale data platforms handling 500GB+ to TB scale.
• Knowledge of Azure Data Services (ADLS, Data Factory, Synapse) or AWS Data Services.
• Experience with Data Modeling, Data Warehousing, and Data Governance.
• Knowledge of CI/CD, DevOps practices, and cloud-native architectures.

Responsibilities

• Design and implement end-to-end data architecture for enterprise-scale data platforms.
• Define data models, data integration strategies, and governance frameworks.
• Architect and optimize Data Lake and Lakehouse solutions using Databricks.
• Collaborate with business stakeholders, engineering teams, and leadership to translate business requirements into technical solutions.
• Establish best practices for data security, quality, scalability, and performance.
• Design and implement ETL/ELT pipelines using Spark/PySpark.
• Drive cloud data architecture initiatives on Azure and/or AWS.
• Lead architecture reviews and provide technical guidance to engineering teams.
• Implement data governance, metadata management, and lineage solutions.

Skills

Data architecture

Data engineering

Stakeholder management

Cloud data platforms

Tools

Databricks

Delta Lake

Unity Catalog

Lakehouse

Spark

PySpark

SQL

Azure Data Services

Data Factory

Synapse

AWS Data Services

Job description

Key Responsibilities

• Design and implement end-to-end data architecture for enterprise-scale data platforms.
• Define data models, data integration strategies, and governance frameworks.
• Architect and optimize Data Lake and Lakehouse solutions using Databricks.
• Collaborate with business stakeholders, engineering teams, and leadership to translate
• business requirements into technical solutions.
• Establish best practices for data security, quality, scalability, and performance.
• Design and implement ETL/ELT pipelines using Spark/PySpark.
• Drive cloud data architecture initiatives on Azure and/or AWS.
• Lead architecture reviews and provide technical guidance to engineering teams.
• Implement data governance, metadata management, and lineage solutions.

Required Skills

• 8+ years of experience in Data Engineering/Data Architecture.
• Strong experience with Databricks, Delta Lake, Unity Catalog, and Lakehouse Architecture.
• Expertise in Spark, PySpark, SQL, and distributed data processing.
• Experience designing large-scale data platforms handling high-volume data (500GB+ to TB
• scale).
• Strong knowledge of Azure Data Services (ADLS, Data Factory, Synapse) or AWS Data
• Services.
• Experience with Data Modeling, Data Warehousing, and Data Governance.
• Knowledge of CI/CD, DevOps practices, and cloud-native architectures.

Preferred Qualifications

• Experience building data platforms from scratch.
• Experience working with Databricks Partner organizations.
• Databricks, Azure, or AWS certifications.
• Strong stakeholder management and leadership skills.

Nice to Have

• Experience with real-time streaming technologies (Kafka, Event Hubs).
• Exposure to AI/ML data platforms and MLOps.
• Knowledge of data cataloging and governance tools.