Databricks Architect

NMDCON; Kolkata District; On-site; INR 1,500,000 - 2,800,000; Full time

Job summary

NMDCON seeks a senior Lakehouse Architect to lead end-to-end Databricks Lakehouse design in India, focusing on scalability, governance, and performance. You will define medallion models, standards for ingestion, transformation, orchestration, and CI/CD, and architect event-driven workflows with EventBridge.

You will ensure governance, lineage, and cost optimization while guiding Spark/Delta performance and using AI copilots for design and documentation.

Qualifications

• Expertise in building Databricks Lakehouse architectures with Delta Lake, Unity Catalog and Workflows.
• Proficient use of AI copilots (GitHub Copilot, ChatGPT) for code generation, debugging, optimization, and documentation.

Responsibilities

• Design medallion architecture and canonical models.
• Define ingestion, transformation, orchestration, and CI/CD standards.
• Architect event-driven ingestion and workflows using EventBridge.
• Ensure governance, lineage, and cost optimization.
• Guide Spark/Delta performance best practices.
• Leverage AI copilots for design and documentation.

Skills

Databricks Lakehouse

Delta Lake

Unity Catalog

Workflows

AI copilots

Job description

Role Overview

Define and lead the end-to-end Lakehouse architecture on Databricks ensuring scalability, governance, and performance.

Key Responsibilities

• Design medallion architecture and canonical models.
• Define standards for ingestion, transformation, orchestration, and CI/CD.
• Architect event-driven ingestion and workflows using EventBridge.
• Ensure governance, lineage, and cost optimization.
• Guide Spark/Delta performance best practices.
• Leverage AI copilots for design and documentation.

Must Have Skills

• Expertise in Databricks Lakehouse, Delta Lake, Unity Catalog, and Workflows.
• Strong usage of AI coding copilots (GitHub Copilot, ChatGPT) for code generation, debugging, optimization, and documentation.

Good to Have Skills

• Healthcare domain exposure including Quality measures, Risk Adjustment (HCC/RAF), and HEDIS.
• Exposure to FHIR/HL7 data models and patient/member/provider entities.