Azure Databricks Platform Admin - Govern, Optimize, Secure

Bhg Inc; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical coverage

Wellness Fridays

401(k) plan

Training & certs

Bonuses

Volunteer opportunities

Job summary

BHG Financial in the United States is seeking an experienced Azure Databricks Administrator to manage, secure, and optimize Databricks in Azure across development, staging, and production. This role partners with data engineering, analytics, cybersecurity, compliance, and business teams to ensure a governed, reliable Databricks environment.

You will implement Unity Catalog, RBAC, audit logging, and cost-efficient configurations, while supporting disaster recovery, security governance, and

Qualifications

• 5+ years of experience administering cloud-based data platforms or analytics environments, with a focus on operational support, governance, and reliability.
• 3+ years of hands-on experience administering Azure Databricks workspaces, Unity Catalog, clusters, jobs, SQL warehouses, and platform settings.
• Strong experience managing Databricks users, groups, workspace permissions, admin roles, service principals, SCIM provisioning, and Microsoft Entra ID integration.
• Experience administering Unity Catalog, including metastores, catalogs, schemas, tables, volumes, permissions, storage credentials, and external locations.
• Ability to configure and maintain compute policies, cluster permissions, instance pools, SQL warehouses, job ownership, and platform usage controls.
• Experience monitoring Databricks platform health, cluster performance, job execution, workload failures, audit logs, and resource utilization.
• Strong troubleshooting skills for Databricks platform issues, Spark workloads, connectivity problems, permission errors, and performance bottlenecks.
• Working knowledge of Python, SQL, PowerShell, Databricks CLI, REST APIs, and automation practices used to support platform administration.
• Experience supporting operational controls, access reviews, audit evidence, change management, runbooks, and platform documentation.
• Knowledge of Databricks security governance, RBAC, least privilege, encryption, secrets management, audit readiness, and secure data access patterns.
• Understanding of Azure networking and security concepts, including private endpoints, firewalls, network security groups, storage access, Key Vault, and secure connectivity.
• Experience partnering with data engineering teams to support reliable pipelines, workload troubleshooting, performance tuning, platform standards, and secure Databricks operations.
• Travel requirement: All roles require travel during the first 6 months of employment to attend the BHG Oars in Experience. After the initial 6 months, ongoing travel is expected at approximately ~5% annually for periodic team on-sites, team meetings, and cross-functional collaboration.
• Work Authorization: This role is not eligible for employer-provided immigration sponsorship. To be considered, applicants must already possess valid U.S. work authorization that will not require sponsorship now or in the future.

Responsibilities

• Configure, maintain, and administer Azure Databricks workspaces and clusters across development, staging, and production environments.
• Monitor cluster health, performance metrics, resource utilization, and platform availability.
• Optimize cluster, SQL warehouse, and workspace configurations for performance and cost efficiency.
• Manage workspace governance, including job scheduling, notebook organization, audit logging, and operational standards.
• Administer user access, workspace permissions, SQL warehouse configurations, and group‑based security controls.
• Troubleshoot infrastructure issues, performance bottlenecks, connectivity problems, and workload failures.
• Support disaster recovery and high‑availability planning, validation, and operational readiness for Databricks workloads.
• Collaborate with data engineering teams to establish Databricks usage standards, support workload reliability, troubleshoot platform issues, optimize Delta Lake performance, and promote governed platform adoption.
• Administer and enforce security policies, RBAC, encryption standards, and access controls.
• Maintain documentation and runbooks for operational procedures.
• Support capacity planning, cost optimization, and platform improvement initiatives.

Skills

Azure Databricks

Databricks admin

Unity Catalog

RBAC/access control

Security governance

Troubleshooting

Python

SQL

PowerShell

REST APIs

Automation scripts

Terraform awareness

Azure networking

Tools

Databricks CLI

Job description

BHG Financial in the United States is seeking an experienced Azure Databricks Administrator to manage, secure, and optimize Databricks in Azure across development, staging, and production. This role partners with data engineering, analytics, cybersecurity, compliance, and business teams to ensure a governed, reliable Databricks environment.

You will implement Unity Catalog, RBAC, audit logging, and cost-efficient configurations, while supporting disaster recovery, security governance, and