Azure Databricks Administrator | Governance & Reliability

Remote; San Francisco (CA); On-site; USD 140,000 - 180,000; Full time

Benefits offered by this job

Medical coverage

PTO & vacation

Wellness Fridays (1st Friday)

401(k) plan

Training & certification opportunities

Quarterly award ceremonies

Volunteer opportunities

Job summary

BHG Financial is seeking an experienced Azure Databricks Administrator to manage, secure, and optimize Databricks environments in Azure. You will partner with data engineering, analytics, cybersecurity, and compliance teams to ensure reliable, governed Databricks operations.

Responsibilities include configuring workspaces, monitoring health, optimizing configurations for performance and cost, and enforcing security policies and RBAC.

Qualifications

• 5+ years of experience administering cloud-based data platforms or analytics environments.
• 3+ years of hands-on experience administering Azure Databricks workspaces, Unity Catalog, clusters, jobs, SQL warehouses, and platform settings.
• Strong experience managing Databricks users, groups, workspace permissions, admin roles, service principals, SCIM provisioning, and Entra ID integration.
• Experience administering Unity Catalog, including metastores, catalogs, schemas, tables, volumes, permissions, storage credentials, and external locations.
• Ability to configure and maintain compute policies, cluster permissions, instance pools, SQL warehouses, job ownership, and platform usage controls.

Responsibilities

• Configure, maintain, and administer Azure Databricks workspaces and clusters across development, staging, and production environments.
• Monitor cluster health, performance metrics, resource utilization, and platform availability.
• Optimize cluster, SQL warehouse, and workspace configurations for performance and cost efficiency.
• Manage workspace governance, including job scheduling, notebook organization, audit logging, and operational standards.
• Administer user access, workspace permissions, SQL warehouse configurations, and group-based security controls.
• Troubleshoot infrastructure issues, performance bottlenecks, connectivity problems, and workload failures.
• Support disaster recovery and high-availability planning, validation, and operational readiness for Databricks workloads.
• Collaborate with data engineering teams to establish Databricks usage standards and promote governed platform adoption.

Skills

5+ years experience

Azure Databricks

Unity Catalog

Users and groups admin

RBAC & security governance

Python/SQL/PowerShell

Automation & runbooks

Azure networking & security

Tools

Databricks CLI

Terraform awareness

REST APIs

Job description

BHG Financial is seeking an experienced Azure Databricks Administrator to manage, secure, and optimize Databricks environments in Azure. You will partner with data engineering, analytics, cybersecurity, and compliance teams to ensure reliable, governed Databricks operations.

Responsibilities include configuring workspaces, monitoring health, optimizing configurations for performance and cost, and enforcing security policies and RBAC.