Databricks Architect

NMDCON; Kolkata District; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

NMDCON seeks a Databricks Architect with 15+ years of experience to design and lead a scalable Lakehouse architecture in the healthcare domain. The role is based in Kolkata and requires working from the office, with immediate joiners in 0-30 days.

You will define standards for ingestion, transformation, orchestration, and CI/CD, architect event-driven data pipelines, and ensure governance, lineage, and cost optimization while guiding performance tuning and leveraging AI copilots for design and

Qualifications

• Extensive experience in designing Databricks Lakehouse architectures.
• Strong knowledge of Delta Lake and Unity Catalog.
• Experience with event-driven data ingestion and orchestration.
• Proficiency in Spark performance tuning and optimization.
• Hands-on AWS architecture including S3, IAM, EventBridge.
• Familiarity with AI copilots (GitHub Copilot, ChatGPT) for code generation and documentation.

Responsibilities

• Define and lead end-to-end Lakehouse architecture on Databricks for scalable, governed solutions.
• Establish standards for data ingestion, transformation, orchestration, and CI/CD pipelines.
• Architect event-driven ingestion and workflows using EventBridge.
• Ensure governance, data lineage, and cost optimization across lakes.
• Guide Spark/Delta performance tuning and best practices.
• Leverage AI copilots to accelerate design, coding, debugging and documentation.

Skills

Databricks Lakehouse

Delta Lake

Unity Catalog

Workflows

AWS architecture

Spark performance

AI copilots

Job description

Role: Databricks Architect

Exp: 15+ yrs

Location: Kolkata (work from office)

Immediate joiners only 0-30 Days

Domain: Healthcare

Role Overview

Define and lead the end-to-end Lakehouse architecture on Databricks ensuring scalability, governance, and performance.

Key Responsibilities

• Design medallion architecture and canonical models.
• Define standards for ingestion, transformation, orchestration, and CI/CD.
• Architect event-driven ingestion and workflows using EventBridge.
• Ensure governance, lineage, and cost optimization.
• Guide Spark/Delta performance best practices.
• Leverage AI copilots for design and documentation.

Must Have Skills

• Expertise in Databricks Lakehouse, Delta Lake, Unity Catalog, and Workflows.
• Strong AWS architecture (S3, IAM, EventBridge).
• Deep Spark performance tuning.
• Strong usage of AI coding copilots (GitHub Copilot, ChatGPT) for code generation, debugging, optimization, and documentation.

Good to Have Skills

• Healthcare domain exposure including Quality measures, Risk Adjustment (HCC/RAF), and HEDIS.
• Exposure to FHIR/HL7 data models and patient/member/provider entities.
• HealthLake architecture.
• Streaming architectures