Azure Databricks Administrator & Governance Lead

Phoenix Technology Partners, LLC; Tampa (FL); On-site; USD 120,000 - 150,000; Full time

Job summary

Phoenix Technology Partners, LLC is seeking an Azure Databricks Administrator to own governance, security, administration, and optimization of the Azure Databricks platform, ensuring a production‑ready analytics and AI environment.

This role requires integrating with Entra ID, Unity Catalog, Key Vault, and private endpoints, monitoring health and costs, and guiding security, compliance, and policy enforcement across development, test, and production.

Qualifications

• 3–5+ years of experience with Azure and enterprise data platforms.
• Strong knowledge of Azure Databricks administration, security, cluster management, and governance.
• Experience with Azure services including Entra ID, Key Vault, Azure Monitor, and Cost Management.

Responsibilities

• Administer Azure Databricks workspaces across Development, Test, and Production.
• Define and enforce governance standards, cluster policies, naming standards, and environment controls.
• Manage security including Azure Entra ID integration, RBAC, Unity Catalog, Key Vault integration, private endpoints, and network security.
• Monitor platform health, usage, reliability, and compliance using enterprise monitoring and alerting tools.
• Optimize cloud consumption, compute resources, storage utilization, cluster sizing, and overall platform costs.
• Provide troubleshooting, support, root-cause analysis, and operational guidance to engineering teams.
• Lead user onboarding, access management, training, and adoption activities.
• Ensure compliance with internal policies, regulatory requirements, and data protection standards.
• Integrate Azure Databricks with Precisely, Microsoft Purview, Microsoft Fabric, and other enterprise platforms.
• Support secure integration with AI solutions such as Atlas, Legora, Azure OpenAI, and future AI platforms.
• Collaborate with Infrastructure, Security, Architecture, Data Engineering, and business stakeholders to align platform strategy.

Skills

Azure Databricks administration

Platform governance

Security management

Cluster management

RBAC & Unity Catalog

Entra ID integration

Key Vault integration

Cost optimization

CI/CD tooling

Terraform

GitHub

Azure DevOps

Data governance

Metadata management

Purview

Tools

Terraform

GitHub

Azure DevOps

Job description

Phoenix Technology Partners, LLC is seeking an Azure Databricks Administrator to own governance, security, administration, and optimization of the Azure Databricks platform, ensuring a production‑ready analytics and AI environment.

This role requires integrating with Entra ID, Unity Catalog, Key Vault, and private endpoints, monitoring health and costs, and guiding security, compliance, and policy enforcement across development, test, and production.