Databricks Platform Engineer: Azure, Automation & Governance

Insight Global; Charlotte (NC); On-site; USD 140,000 - 190,000; Full time

Job summary

Insight Global is seeking a Databricks Platform Engineer to own provisioning, configuration, and ongoing management of Databricks environments within Azure, ensuring secure, scalable, and standardized platform operations.

You will establish workspace standards, manage cluster policies and networking, onboard new data sources, integrate with Azure services, implement RBAC and governance, and automate infrastructure with Terraform and CI/CD while collaborating with data engineering teams to enable

Qualifications

• Strong hands-on experience administering Azure Databricks in enterprise environments.
• Provisioning, configuring, and managing Databricks workspaces.
• Deep knowledge of Azure services and cloud-based data platforms.
• Experience managing Databricks workspaces, clusters, and SQL Warehouses.
• Security best practices including RBAC and governance.

Responsibilities

• Provision and manage Databricks environments in Azure.
• Establish workspace standards, policies, and networking integrations.
• Implement RBAC, access controls and governance controls.
• Automate infrastructure with Terraform and CI/CD pipelines.
• Collaborate with data engineering teams to enable data pipelines.

Skills

Azure Databricks administration

Terraform IaC

Azure cloud services expertise

Databricks workspace/cluster managing

RBAC & security best practices

Data governance (Unity Catalog)

CI/CD for data platforms

Data ingestion & integration

Cost optimization & performance tuning

Collaboration with cross-functional

Tools

Databricks CLI

Azure DevOps

GitHub Copilot

Job description

Insight Global is seeking a Databricks Platform Engineer to own provisioning, configuration, and ongoing management of Databricks environments within Azure, ensuring secure, scalable, and standardized platform operations.

You will establish workspace standards, manage cluster policies and networking, onboard new data sources, integrate with Azure services, implement RBAC and governance, and automate infrastructure with Terraform and CI/CD while collaborating with data engineering teams to enable