Azure Databricks Infra & Migration Engineer

Cayuse Holdings, LLC; King of Prussia (PA); On-site; USD 94,000 - 99,000; Full time

Job summary

Cayuse Holdings, LLC is seeking an experienced Azure Databricks Infrastructure Engineer in King of Prussia, PA to execute migrations of Databricks environments between Azure tenants. The role emphasizes risk mitigation, downtime minimization, and collaboration with architects, security, and business stakeholders.

The candidate should have deep expertise in Databricks, Azure cloud services, identity and access management, networking, data engineering, and platform modernization to drive a

Qualifications

• Extensive Azure and Databricks migration experience across tenants.
• Experience designing secure cloud landing zones and governance.
• Proficiency with IaC and automation for migrations.

Responsibilities

• Analyze tenant dependencies, networking, DNS, Private Endpoints, and IAM.
• Define migration waves and cutover strategies for Databricks environments.
• Migrate workspaces, policies, schedules, repositories, and secrets.
• Validate Unity Catalog, data governance, and metadata schemas.
• Develop rollback and recovery procedures and automate where possible.

Skills

Azure

Azure Databricks

Microsoft Entra ID

Azure Virtual Networks

Private Endpoints

Azure Key Vault

Azure Storage Accounts

Azure Data Lake Storage Gen2

Azure Monitor

Log Analytics

Azure Policy

Azure RBAC

Databricks

Workspace administration

Unity Catalog

Delta Lake

Databricks Repos

MLflow

Cluster management

Cluster policies

Secret scopes

Databricks REST APIs

Automation

Terraform

Azure DevOps

GitHub Actions

PowerShell

Azure CLI

Databricks CLI

Tools

Terraform

Bicep

ARM Templates

Databricks CLI

Azure CLI

PowerShell

GitHub Actions

Databricks REST APIs

Job description

Cayuse Holdings, LLC is seeking an experienced Azure Databricks Infrastructure Engineer in King of Prussia, PA to execute migrations of Databricks environments between Azure tenants. The role emphasizes risk mitigation, downtime minimization, and collaboration with architects, security, and business stakeholders.

The candidate should have deep expertise in Databricks, Azure cloud services, identity and access management, networking, data engineering, and platform modernization to drive a