Azure Databricks Admin

Saama; Pune District; On-site; INR 2,800,000 - 4,000,000; Full time

Job summary

Saama seeks a Senior Azure and Databricks Administrator to lead architecture, governance, and optimization of our data platform. With 6–8 years of IT/Cloud experience, you will design enterprise Databricks environments, implement Unity Catalog and cross-workspace sharing, and drive secure automation across Azure resources.

You will collaborate with Data Architects, Data Engineers, and Cloud Security to ensure resilient, cost-efficient platforms aligned with best practices.

Qualifications

• 6–8 years of IT/Cloud Infrastructure experience with 3–4+ years hands-on Azure Databricks in a large-scale production environment.
• Expert-level understanding of the Azure ecosystem, Big Data, networking, and identity management.
• Deep Databricks architecture knowledge (Data Plane/Control Plane), Unity Catalog, Delta Lake, REST APIs/CLI.
• Strong scripting skills (Python, Bash, PowerShell) and Terraform deployments for cloud infra.

Responsibilities

• Design and deploy enterprise-grade Azure Databricks topologies, including multi-workspace environments.
• Lead migration to Databricks Unity Catalog and implement cross-workspace data sharing strategies.
• Architect IAM frameworks using Azure Entra ID, SCIM provisioning, and RBAC/ABAC models.
• Design DR plans, backup routines, and high-availability configurations for data platforms.

Skills

Azure Databricks admin

IAM RBAC ABAC

Data governance

CI/CD pipelines

Leadership/mentorship

Scripting (Python/Bash/PowerShell)

Spark performance tuning

Tools

Terraform

Bicep

Azure DevOps

GitHub Actions

Job description

We are seeking a Senior Azure and Databricks Administrator to act as a Subject Matter Expert (SME) and lead the management, architecture, and optimization of our data platform infrastructure. With 6–8 years of experience, you will go beyond daily administration to design secure, enterprise-scale Databricks environments, implement comprehensive data governance strategies, and drive automation. You will partner closely with Data Architects, Data Engineers, and Cloud Security teams to ensure our Azure and Databricks ecosystems are highly resilient, cost-efficient, and aligned with industry best practices.

Key Responsibilities

Architecture & Enterprise Administration

• Platform Architecture: Design and deploy enterprise-grade Azure Databricks topologies, including multi-workspace environments, complex VNet injection, and Hub-and-Spoke network architectures.
• Unity Catalog & Data Governance Strategy: Lead the migration to and enterprise-wide implementation of Databricks Unity Catalog. Design complex data lineage, row/column-level security, and cross-workspace data sharing strategies (Delta Sharing).
• Advanced Access Management: Architect scalable Identity and Access Management (IAM) frameworks using Azure Entra ID (Azure AD), SCIM provisioning, and complex RBAC/ABAC models.
• Disaster Recovery & High Availability: Design and test failover strategies, backup routines, and Disaster Recovery (DR) plans for critical data platforms and metastores.

Infrastructure & Security Management

• Advanced Azure Networking: Manage enterprise network security including Azure Firewall, Private Link / Private Endpoints, UDRs (User Defined Routes), and custom DNS configurations for secure data exfiltration prevention.
• Storage & Secret Management: Oversee enterprise storage strategies (ADLS Gen2) and secure secret management pipelines using Azure Key Vault backed by strict compliance policies.

DevOps, Automation & Mentorship

• Infrastructure as Code (IaC) Mastery: Build and maintain reusable Terraform modules or Bicep templates for zero-touch deployment of Databricks workspaces, clusters, and Azure resources.
• Advanced CI/CD: Architect sophisticated MLOps and DataOps CI/CD pipelines using Azure DevOps or GitHub Actions, integrating automated testing and deployment of Databricks assets.
• Technical Leadership: Mentor junior administrators and data engineers on platform best practices, Spark compute optimization, and secure coding standards. Act as the highest level of escalation for complex platform outages.

Required Skills & Qualifications

• Experience: 6–8 years of comprehensive experience in IT/Cloud Infrastructure, with at least 3–4+ years of dedicated, hands-on experience managing Azure Databricks in a large-scale production environment.
• Cloud Architecture: Expert-level understanding of Azure ecosystem, specifically surrounding Big Data, networking (peering, Private Link, NSGs), and robust identity management.
• Databricks Expertise: Deep, authoritative knowledge of the Databricks architecture (Data Plane/Control Plane), Unity Catalog, Delta Lake storage mechanics, and Databricks REST APIs/CLI.
• Automation/DevOps: Strong scripting skills (Python, Bash, PowerShell). Proven expertise in writing and maintaining complex Terraform deployments for cloud infrastructure.
• Performance Tuning: Strong ability to diagnose Spark UI metrics to assist data engineering teams in optimizing poorly performing clusters or jobs.