Azure Databricks Platform Architect / Technical Lead

NewVision Software; Pune District; Hybrid; INR 3,000,000 - 6,000,000; Full time

Benefits offered by this job

Hybrid work model

Remote Pan-India option

Job summary

New Vision Softcom & Consultancy Pvt. Ltd is seeking an experienced Azure Databricks Platform Architect / Technical Lead.

You will design, provision, and manage enterprise-scale Databricks environments, including networking, security, governance, and platform operations, with a strong emphasis on IaC and CI/CD. The ideal candidate has 8+ years in data engineering or platform architecture, with at least 3 years in Azure Databricks, and will collaborate across Data Eng, DevOps, Infra, and Security

Qualifications

• 8+ years in Data Eng, Cloud Infra, or Platform Architecture.

Responsibilities

• Design enterprise-scale Azure Databricks platform architecture.
• Provision and configure Databricks workspaces, clusters, and policies.
• Design Azure networking (VNets/subnets) and secure connectivity.
• Configure Unity Catalog, RBAC, data lineage, and governance.
• Implement platform security: Key Vault, secrets, rotation, auditing.
• Automate infra with Terraform/Bicep/ARM and CI/CD.
• Set platform standards for monitoring, cost, and ops.
• Support Databricks development (PySpark, Spark SQL, Delta Lake).
• Lead technical design decisions with cross-functional teams.

Skills

Azure Databricks

Data Engineering

Cloud Infra

Platform Architecture

Python

PySpark

SQL

Delta Lake

Medallion architecture

Terraform

Tools

Terraform

Bicep

ARM Templates

CI/CD

Job description

Azure Databricks Platform Architect / Te...

NVS/ADPA-TL/1901348

• AI & Analytics
• Pune

Posted On 21 Oct 2026

End Date 21 Oct 2027

Required Experience 10 - 14 years

Basic Section

Grade --

Role Architect

Employment Type Full Time

Employee Category --

Organisational

Group Company NewVison

Company Name New Vision Softcom & Consultancy Pvt. Ltd

Function Business Units (BU)

Department/Practice AI & Analytics

Region APAC

Country India

Base office location Pune

Working model Hybrid

Weekly Off Pune office Standard

State Maharashtra

Job Description

Hybrid preferred however can be Pan India Remote for the right candidate

About the Role

We are looking for an experienced Azure Databricks Platform Architect / Technical Lead with strong hands-on experience in enterprise data platform architecture, infrastructure, and Databricks development.

The ideal candidate should be able to design, provision, and manage enterprise-scale Databricks environments, including networking, security, governance, and platform operations.

Responsibilities

Design and implement enterprise-scale Azure Databricks platform architecture, including multi-workspace environments and Azure landing zones.

Provision and configure Databricks workspaces, clusters, cluster policies, and compute resources.

Design Azure networking solutions, including VNets, subnets, NSGs, CIDR planning, IP allocation, and secure connectivity.

Configure and manage Unity Catalog, including metastore setup, RBAC, permissions, data lineage, and governance.

Implement platform security, including Azure Key Vault, secrets management, credential rotation, and auditing.

Automate infrastructure provisioning and deployments using Terraform, Bicep, ARM Templates, and CI/CD pipelines.

Define platform standards for monitoring, performance, cost optimization, and operational support.

Support Databricks development, including PySpark, Spark SQL, Delta Lake, and Medallion architecture.

Lead technical design decisions and collaborate with Data Engineering, DevOps, Infrastructure, and Security teams.

Requirements

• 8+ years of experience in Data Engineering, Cloud Infrastructure, or Platform Architecture, including at least 3 years with Azure Databricks.
• Hands-on experience designing and provisioning Azure Databricks workspaces from scratch.
• Strong experience with enterprise Databricks architecture, including multi-workspace environments and secure connectivity.
• Strong Azure networking knowledge, including VNets, subnets, NSGs, CIDR planning, routing, and IP address management.
• Hands-on experience with Unity Catalog metastore configuration, RBAC, access controls, and data lineage implementation.
• Experience with Azure security, Key Vault, secret rotation, and credential lifecycle management.
• Experience with Infrastructure as Code, preferably Terraform, and CI/CD automation.
• Strong understanding of Databricks clusters, cluster policies, compute management, and performance optimization.
• Experience with enterprise data governance, monitoring, auditing, and production support.
• Good understanding of Python, PySpark, SQL, Delta Lake, and Medallion architecture.
• Experience leading technical design and architecture discussions.

Nice to Have

• Experience with multi-region Azure deployments and complex enterprise networking.
• Experience with Databricks Asset Bundles (DABs).
• Experience with Azure Monitor, Log Analytics, and cost governance.
• Experience in banking, insurance, or other regulated industries.
• Azure or Databricks certifications.