Azure Databricks Platform Guardian & Optimization Lead

Phoenix Technology Partners, LLC

Tampa (FL)

On-site

USD 110,000 - 170,000

Full time

27 hours ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Healthcare Stipend

Job summary

Phoenix Technology Partners, LLC seeks an Azure Databricks Administrator to own governance, security, and cost optimization of the Azure Databricks platform. You will integrate with Purview, Fabric, and AI solutions while supporting enterprise stakeholder needs.

The role requires strong governance, security, and cloud cost management, with hands-on experience across DevOps tools and IaC frameworks. Tampa, FL‑based on-site role with enterprise-scale responsibilities.

Qualifications

3-5+ years of experience supporting Azure and enterprise data platforms.
Strong knowledge of Azure Databricks administration, security, cluster management, and governance.
Experience with Azure services including Entra ID, Key Vault, Azure Monitor, Log Analytics, Networking, and Cost Management.
Understanding of CI/CD and Infrastructure as Code (Terraform), GitHub, and Azure DevOps.
Experience with data governance, metadata management, lineage, and Microsoft Purview.

Responsibilities

Administer Azure Databricks workspaces across Development, Test, and Production environments.
Define and enforce platform governance standards, cluster policies, naming standards, and environment controls.
Manage security including Azure Entra ID integration, RBAC, Unity Catalog, Key Vault integration, private endpoints, and network security.
Monitor platform health, usage, reliability, and compliance using enterprise monitoring and alerting tools.
Optimize cloud consumption, compute resources, storage utilization, cluster sizing, and overall platform costs.
Provide troubleshooting and operational guidance to engineering teams; lead onboarding and access management.
Ensure compliance with internal policies, regulatory requirements, and data protection standards.
Integrate Databricks with Microsoft Purview, Fabric, and other enterprise platforms; support AI integrations.