Azure Databricks Administrator

Phoenix Technology Partners, LLC; Tampa (FL); On-site; USD 110,000 - 180,000; Full time

Job summary

Phoenix Technology Partners, LLC is seeking an Azure Databricks Administrator to own governance, security, and operations of the Azure Databricks platform. You will ensure secure, scalable deployment and integration with enterprise AI solutions and Microsoft Fabric, Purview, and Precisely.

Responsibilities include managing Entra ID, RBAC, Unity Catalog, and monitoring, while optimizing costs and onboarding users.

Qualifications

• 5+ years of experience with Azure and enterprise data platforms.

Responsibilities

• Administer Azure Databricks workspaces across Development, Test, and Production environments.
• Define and enforce platform governance standards, cluster policies, naming standards, and environment controls
• Manage security including Azure Entra ID integration, RBAC, Unity Catalog, Key Vault integration, private endpoints, and network security.
• Monitor platform health, usage, reliability, and compliance using enterprise monitoring and alerting tools.
• Optimize cloud consumption, compute resources, storage utilization, cluster sizing, and overall platform costs.
• Provide troubleshooting, support, root‑cause analysis, and operational guidance to engineering teams.
• Lead user onboarding, access management, training, and adoption activities.
• Ensure compliance with internal policies, regulatory requirements, and data protection standards.
• Integrate Azure Databricks with Precisely, Microsoft Purview, Microsoft Fabric, and other enterprise platforms.
• Support secure integration with AI solutions such as Atlas, Legora, Azure OpenAI, and future AI platforms.
• Collaborate with Infrastructure, Security, Architecture, Data Engineering, and business stakeholders to align platform strategy.

Skills

Platform governance

Security management

Cloud cost optimization

User onboarding

Collaboration

Tools

Azure Databricks

Azure Entra ID

Key Vault

Unity Catalog

Terraform

GitHub

Azure DevOps

Purview

Job description

Position Summary

The Azure Databricks Administrator owns the governance, security, administration, optimization, and operational support of the Azure Databricks platform. The role ensures Azure Databricks is deployed and managed as a secure, scalable, cost-effective, and production‑ready enterprise analytics and AI platform while supporting integration with Microsoft Fabric, Microsoft Purview, Precisely, and other enterprise AI solutions.

Position Summary

The Azure Databricks Administrator owns the governance, security, administration, optimization, and operational support of the Azure Databricks platform. The role ensures Azure Databricks is deployed and managed as a secure, scalable, cost-effective, and production‑ready enterprise analytics and AI platform while supporting integration with Microsoft Fabric, Microsoft Purview, Precisely, and other enterprise AI solutions.

Duties And Accountabilities

• Administer Azure Databricks workspaces across Development, Test, and Production environments.
• Define and enforce platform governance standards, cluster policies, naming standards, and environment controls
• Manage security including Azure Entra ID integration, RBAC, Unity Catalog, Key Vault integration, private endpoints, and network security.
• Monitor platform health, usage, reliability, and compliance using enterprise monitoring and alerting tools.
• Optimize cloud consumption, compute resources, storage utilization, cluster sizing, and overall platform costs.
• Provide troubleshooting, support, root‑cause analysis, and operational guidance to engineering teams.
• Lead user onboarding, access management, training, and adoption activities.
• Ensure compliance with internal policies, regulatory requirements, and data protection standards.
• Integrate Azure Databricks with Precisely, Microsoft Purview, Microsoft Fabric, and other enterprise platforms.
• Support secure integration with AI solutions such as Atlas, Legora, Azure OpenAI, and future AI platforms.
• Collaborate with Infrastructure, Security, Architecture, Data Engineering, and business stakeholders to align platform strategy.

Success Measures

• High platform availability and reliability.
• Improved governance and security compliance.
• Reduced cloud costs through optimization initiatives.
• Faster onboarding of analytics and AI workloads.
• Accurate metadata, lineage, and governance integration.
• Adoption of platform standards and best practices.

Qualifications

• 3 5+ years of experience supporting Azure and enterprise data platforms.
• Strong knowledge of Azure Databricks administration, security, cluster management, and governance.
• Experience with Azure services including Entra ID, Key Vault, Azure Monitor, Log Analytics, Networking, and Cost Management.
• Understanding of CI/CD, Infrastructure as Code (Terraform), GitHub, and Azure DevOps.
• Experience with data governance, metadata management, lineage, and Microsoft Purview.

Knowledge of Microsoft Fabric, Lakehouse architecture, Delta Lake, and modern analytics platforms.