Azure Databricks Engineer

VDart Inc; Alberta; Remote; CAD 100,000 - 130,000; Full time

Job summary

A leading company is seeking an Azure Databricks Engineer for a remote contract position. The role involves extensive work with Azure Databricks, focusing on data engineering best practices, including Unity Catalog setup, data governance, and job management. Candidates should have substantial experience in Azure technologies, with a strong emphasis on PySpark and enterprise environments.

Qualifications

• 5+ years of experience in Azure Data Engineering with a focus on Azure Databricks.
• Strong knowledge in PySpark, Spark SQL, Delta Lake, and Databricks Workflows.
• Experience working in enterprise-grade environments with data lake architectures.

Responsibilities

• Setting up and configuring Unity Catalog, managing access control, and implementing security best practices.
• Managing Databricks REST APIs and job orchestration.
• Provisioning data platform resources using infrastructure-as-code.

Skills

Azure Data Engineering

Azure Databricks

PySpark

SQL

Powershell

Terraform

Git

Azure security and networking

Job description

Role: Azure Databricks Engineer
Location: Remote
Mode: Contract

Azure Databricks, ADF, Databricks asset bundle, python, Pyspark, SQL, Powershell, TEX: 7 + yrs and REX: 5+

• 5+ years of experience in Azure Data Engineering, with strong focus on Azure Databricks.
• Expertise in Unity Catalog setup, configuration, lineage, access control, and security best practices.
• Strong knowledge of PySpark, Spark SQL, Delta Lake, and Databricks Workflows.
• Solid understanding of Databricks REST APIs, workspace management, and job orchestration.
• Experience with Git-based version control and CI/CD integration (GitHub Actions, Azure DevOps, etc.).
• Hands-on experience with infrastructure-as-code (Terraform preferred) for provisioning data platform resources.
• Knowledge of Azure security and networking - Managed identities, Private Endpoints, VNETs, RBAC, NSGs.
• Experience working in enterprise-grade environments with data lake architectures and governance frameworks.