Chief Lakehouse Architect – Databricks CoE

Jade Global; Maharashtra; On-site; INR 2,862,595 - 4,293,893; Full time

Job summary

Jade Global is seeking a Chief Lakehouse Architect based in India, Maharashtra, responsible for defining and executing enterprise-grade Databricks Lakehouse architecture. The role involves designing key reference architectures and mentoring engineers while optimizing costs across Databricks platforms.

The ideal candidate will have extensive experience in data architecture and specific expertise in Databricks and Apache Spark, along with a firm grasp on cost-management strategies and cloud-native solutions.

Qualifications

• 12–15 years in data architecture.
• 5–7 years hands-on Databricks & Apache Spark.
• 3+ years designing enterprise Databricks platforms.

Responsibilities

• Define Databricks reference architectures.
• Own standards for Delta Lake and medallion architecture.
• Design multi-workspace Databricks platform architectures.
• Lead Databricks migrations from legacy data warehouses.
• Design, review and approve architecture for all Databricks deals.
• Mentor architects and senior Databricks engineers.
• Define Databricks FinOps framework.
• Optimize cluster policies and job scheduling.
• Work on performance-to-cost optimization.
• Advise on Databricks cost strategies.

Skills

Databricks platform internals & optimization

Spark performance tuning and scalability

Delta Lake internals (ACID, compaction, Z-order)

Databricks Jobs, Workflows, CI/CD, IaC

Cloud-native Databricks (AWS / Azure / GCP)

Cluster tuning & auto-scaling strategies

Cloud billing & monitoring tools

Cost optimization patterns for Spark workloads

Job description

Overview

Chief Lakehouse Architect – Databricks CoE. Principal architect responsible for defining and executing enterprise-grade Databricks Lakehouse architecture standards, engagements and guiding complex solution designs. Drive cost optimization and financial governance for Databricks platforms across clients and internal workloads.

Responsibilities

• Define Databricks reference architectures (batch, streaming, ML, GenAI)
• Own standards for Delta Lake, medallion architecture, Unity Catalog
• Design multi-workspace Databricks platform architectures
• Lead Databricks migrations from legacy data warehouses programs
• Design, Review and approve architecture for all Databricks deals
• Mentor architects and senior Databricks engineers
• Define Databricks FinOps framework
• Optimize cluster policies, DBU usage, and job scheduling
• Work with engineering teams on performance-to-cost optimization
• Advise leadership and clients on Databricks cost strategies

Experience

• 12–15 years in data architecture
• 5–7 years hands-on Databricks & Apache Spark
• 3+ years designing enterprise Databricks platforms, managing Databricks costs at scale

Skills

• Databricks platform internals & optimization
• Spark performance tuning and scalability
• Delta Lake internals (ACID, compaction, Z-order)
• Databricks Jobs, Workflows, CI/CD, IaC
• Cloud-native Databricks (AWS / Azure / GCP)
• Cluster tuning & auto-scaling strategies, Databricks DBU model & pricing
• Cloud billing & monitoring tools
• Cost optimization patterns for Spark workloads

Certifications (Preferred)

• Databricks Data Engineer Professional
• FinOps Practitioner