Azure Databricks Admin

Saama-Technologies; Pune District; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Saama-Technologies seeks a Senior Azure and Databricks Administrator to lead the management, architecture, and optimization of our data platform infrastructure. With 6–8 years of IT experience, you will design secure, enterprise-scale Databricks environments and implement comprehensive data governance strategies.

You will partner with Data Architects, Data Engineers, and Cloud Security teams to ensure Azure and Databricks ecosystems are resilient, cost-efficient, and aligned with industry best

Qualifications

• 6–8 years in IT/Cloud Infrastructure with focus on cloud data platforms.
• 3–4+ years hands-on Azure Databricks in production.
• Expertise in Unity Catalog, Delta Lake, and data governance.
• IAM, RBAC/ABAC in Azure with Entra ID experience.
• IaC with Terraform or Bicep for Databricks deployments.
• CI/CD pipelines using Azure DevOps or GitHub Actions.

Responsibilities

• Design and deploy enterprise Azure Databricks topologies across multi-workspace environments.
• Lead Unity Catalog migration and enterprise-wide governance strategies.
• Architect IAM frameworks and secure data sharing controls.
• Design DR/HA plans and backup strategies for data platforms.
• Manage advanced Azure networking, Private Link, and DNS for security.
• Mentor junior admins and engineers on best practices and Spark optimization.

Skills

Azure Databricks administration

Cloud infrastructure

Terraform

Bicep

Python

CI/CD

Data governance

IAM management

Unity Catalog

Spark optimization

Networking (Azure)

Tools

Terraform

Bicep

Azure DevOps

GitHub Actions

Job description

We are seeking a Senior Azure and Databricks Administrator to act as a Subject Matter Expert (SME) and lead the management, architecture, and optimization of our data platform infrastructure. With 6–8 years of experience, you will go beyond daily administration to design secure, enterprise-scale Databricks environments, implement comprehensive data governance strategies, and drive automation. You will partner closely with Data Architects, Data Engineers, and Cloud Security teams to ensure our Azure and Databricks ecosystems are highly resilient, cost-efficient, and aligned with industry best practices.

Key Responsibilities

Architecture & Enterprise Administration

Platform Architecture: Design and deploy enterprise-grade Azure Databricks topologies, including multi-workspace environments, complex VNet injection, and Hub-and-Spoke network architectures.

Unity Catalog & Data Governance Strategy: Lead the migration to and enterprise-wide implementation of Databricks Unity Catalog. Design complex data lineage, row/column-level security, and cross-workspace data sharing strategies (Delta Sharing).

Advanced Access Management: Architect scalable Identity and Access Management (IAM) frameworks using Azure Entra ID (Azure AD), SCIM provisioning, and complex RBAC/ABAC models.

Disaster Recovery & High Availability: Design and test failover strategies, backup routines, and Disaster Recovery (DR) plans for critical data platforms and metastores.

Infrastructure & Security Management

Advanced Azure Networking: Manage enterprise network security including Azure Firewall, Private Link / Private Endpoints, UDRs (User Defined Routes), and custom DNS configurations for secure data exfiltration prevention.

Storage & Secret Management: Oversee enterprise storage strategies (ADLS Gen2) and secure secret management pipelines using Azure Key Vault backed by strict compliance policies.

DevOps, Automation & Mentorship

Infrastructure as Code (IaC) Mastery: Build and maintain reusable Terraform modules or Bicep templates for zero-touch deployment of Databricks workspaces, clusters, and Azure resources.

Advanced CI/CD: Architect sophisticated MLOps and DataOps CI/CD pipelines using Azure DevOps or GitHub Actions, integrating automated testing and deployment of Databricks assets.

Technical Leadership: Mentor junior administrators and data engineers on platform best practices, Spark compute optimization, and secure coding standards. Act as the highest level of escalation for complex platform outages.

Required Skills & Qualifications

Experience

6–8 years of comprehensive experience in IT/Cloud Infrastructure, with at least 3–4+ years of dedicated, hands‑on experience managing Azure Databricks in a large-scale production environment.

Cloud Architecture

Expert‑level understanding of Azure ecosystem, specifically surrounding Big Data, networking (peering, Private Link, NSGs), and robust identity management.

Databricks Expertise

Deep, authoritative knowledge of the Databricks architecture (Data Plane/Control Plane), Unity Catalog, Delta Lake storage mechanics, and Databricks REST APIs/CLI.

Automation/DevOps

Strong scripting skills (Python, Bash, PowerShell). Proven expertise in writing and maintaining complex Terraform deployments for cloud infrastructure.

Performance Tuning

Strong ability to diagnose Spark UI metrics to assist data engineering teams in optimizing poorly performing clusters or jobs.