Data Architect

Recro; Chennai; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

Recro is seeking an experienced Databricks Data Architect to lead the architecture, design, and optimization of our enterprise Databricks Lakehouse platform. You will define target-state architectures, modernize legacy platforms, and deliver high-performance, governed data products at scale.

Responsibilities include designing lakehouse solutions with Delta Lake and Unity Catalog, migrating workloads from Synapse/SQL Server/Hadoop to PySpark and Delta-based architectures, and implementing CI/CD

Qualifications

• 12+ years in Data Engineering/Architecture.
• 5+ years specifically in Databricks architecture.
• Strong experience with Azure cloud platform (ADLS Gen2, ADF).
• Experience migrating legacy systems to Databricks Lakehouse.
• Knowledge of data modeling (Bronze/Silver/Gold) and performance tuning.

Responsibilities

• Define target-state Databricks Lakehouse architectures at scale.
• Lead modernization of legacy platforms (Synapse, SQL Server, Hadoop).
• Model data with Medallion architecture and optimize performance/costs.
• Build streaming and batch ingestion pipelines and Delta CDF.
• Ensure governance, security, lineage via Unity Catalog and Data Quality.

Skills

Data architecture

Databricks architecture

PySpark

Spark SQL

Python

Delta Lake

Unity Catalog

DLT

MLflow

Azure cloud

Data governance

Automation

Tools

Git

Terraform

Azure DevOps

DABs

Job description

Are you passionate about building state-of-the-art data platforms and leading modern enterprise transformations? We are looking for an experienced Databricks Data Architect to lead the architecture, design, and optimization of our enterprise Databricks Lakehouse platform.

In this role, you will define target-state architectures, modernize legacy platforms, and build high-performance, secure, and governed data products at scale.

• Lakehouse Architecture: Design & implement enterprise-scale Databricks Lakehouse solutions leveraging Delta Lake, Unity Catalog, Delta Live Tables (DLT), and Databricks SQL.
• Modernization & Migration: Lead migration and refactoring of legacy Synapse, SQL Server, Hadoop, and T-SQL workloads into PySpark, Databricks SQL, and Delta-based architectures.
• Data Modeling & Performance: Architect Medallion (Bronze/Silver/Gold) models and implement Liquid Clustering, Z-Ordering, partitioning, and cost optimization strategies.
• Real-time Ingestion: Build robust streaming and batch ingestion frameworks using Auto Loader, Structured Streaming, and Delta Change Data Feed (CDF).
• Governance & Security: Integrate enterprise security, data quality, lineage, and compliance via Unity Catalog.
• Automation & DataOps: Establish CI/CD pipelines, Infrastructure-as-Code (Terraform), and Databricks Asset Bundles (DAB).
• Experience: 12+ years in Data Engineering/Architecture, with 5+ years specifically in Databricks architecture.
• Core Tech Stack: Databricks Lakehouse, PySpark, Spark SQL, Python, Delta Lake, Unity Catalog, DLT, and MLflow.
• Cloud Platform: Strong hands-on experience with Microsoft Azure (ADLS Gen2, ADF, Azure Entra ID, Event Hubs).
• Automation: Hands-on experience with Git, Terraform, Azure DevOps, and DABs.
• Domain: Banking and Financial Services (BFS) domain experience is highly preferred.
• Concepts: Deep understanding of Data Mesh principles, Data Products, and enterprise modernization.