DATA ARCHITECT - Databricks

Happiest Minds Technologies; Bengaluru; On-site; INR 4,200,000 - 6,200,000; Full time

Job summary

Platform/solution architect for enterprise lakehouse programs is needed to govern, secure and lineage-track data assets while enforcing cost/performance guardrails and platform standards.

Responsibilities include defining target-state architectures, Unity Catalog topology, and migration patterns for modernization efforts. Strong focus on DataOps, observability, and security posture across the platform.

Qualifications

• Expertise in Spark/Delta internals and large-scale performance engineering.
• Knowledge of Unity Catalog governance, RBAC/ABAC, and security auditing.
• Experience with DLT/Workflows standards, migration playbooks, and ADRs.

Responsibilities

• Own target-state lakehouse architecture including metastores and Unity Catalog topology.
• Define platform standards for DLT/Workflows, streaming, data contracts and schema strategy.
• Establish cluster policies, cost guardrails and FinOps dashboards at org level.
• Lead modernization with migration patterns and cutover for legacy DW/ETL.
• Set DataOps & observability standards: CI/CD, SLIs/SLOs, security posture.

Skills

Spark/Delta internals

Unity Catalog governance

DLT/Workflows standards

Job description

Platform/solution architect for enterprise lakehouse programs: governance, security, lineage, cost/performance guardrails and platform standards.

• Core Responsibilities
  • Own target-state lakehouse architecture: metastores, Unity Catalog topology, workspace strategy, governed sharing, lineage.
  • Define platform standards for DLT/Workflows, streaming, CDC/SCDs, data contracts, and schema strategy.
  • Establish cluster policies, pools, autoscaling, Photon adoption, cost guardrails & FinOps dashboards at org level.
  • Lead modernization (legacy DW/ETL ? Databricks) with migration patterns, parallel run, and cutover.
  • Set DataOps & observability standards: CI/CD, test suites, SLIs/SLOs, reliability scorecards; security/privacy posture.
• Must-have Skills (Screening Focus)
  • Expert Spark/Delta internals; large-scale performance engineering and cost governance.
  • Unity Catalog governance (RBAC/ABAC), row/column security; audit & compliance readiness.
  • Estate-wide DLT/Workflows standards; migration playbooks; ADRs & platform blueprints.
• Nice-to-have (Prefer, not Mandatory)
  • Delta Sharing, Marketplace, Lakehouse Federation; Model Serving/Vector Search awareness.
  • Multi-cloud architecture; FinOps maturity.