Databricks Platform Engineer

BrokerLink; Toronto; On-site; CAD 101,800 - 124,400; Full time

Benefits offered by this job

Flexible work arrangements

Wellness account

Employee share plan

Job summary

BrokerLink seeks a skilled Databricks Platform Engineer to own and optimize our Azure Databricks environment, configure clusters, manage IAM, and ensure secure, scalable data pipelines. You will collaborate with data engineers and data scientists to enable analytics workloads and Power BI integrations.

The role requires Terraform for IaC, Azure DevOps CI/CD pipelines, and scripting in Python or Bash. You will monitor performance, implement cost controls, and document procedures for onboarding

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Proven experience administering Azure Databricks, workspace and cluster management.
• Strong knowledge of Azure cloud services (Data Lake, Synapse, Entra, DevOps).
• IaC with Terraform and CI/CD pipelines for cloud resources.

Responsibilities

• Administer, configure, and maintain Azure Databricks workspaces and clusters.
• Own platform automation and IaC (Terraform) and Azure DevOps CI/CD pipelines.
• Monitor performance and troubleshoot Databricks jobs and data pipelines.
• Implement security, cost management, and compliance best practices.
• Collaborate with data engineers/scientists and support Power BI dashboards.

Skills

Databricks administration

Terraform

CI/CD pipelines

Python/Bash scripting

Azure cloud services

Power BI integration

Networking and IAM

Education

Bachelor’s degree in Computer Science/IT or related field

Tools

Terraform

Azure DevOps

Power BI

Job description

Pay and Benefits

• Flexible work arrangements
• Multiple benefits offered to support physical and mental wellbeing, Wellness account and much more
• Share plan & other savings

Salary Range (but Not Limited To): 101,800 - 124,400

Incentive plan: Annual bonus: 12% target, based on the base salary, with a potential payout of up to 200% (subject to personal and company performance).

As part of our commitment to Win As A Team, we share our success with employees through our incentive programs and Employee Share Purchase Plan (ESPP) – with BrokerLink matching a portion of your contributions.

Our Group RRSP, with company matching DPSP offerings provide flexibility and long-term security for our employees beyond their careers.

About The Role

We are seeking a skilled and proactive Databricks Platform Engineer to join our team. The ideal candidate will be responsible for owning, managing, optimizing, and supporting our Databricks platform end-to-end, including Azure-based deployments and supporting infrastructure-as-code and CI/CD practices. Experience with cloud networking and integration with downstream analytics tooling (including Power BI) is essential to ensure the reliability, security, and performance of our big data and analytics infrastructure.

What You'll Do Here

• Administer, configure, and maintain Azure Databricks workspaces, including user management, cluster setup, resource allocation, provisioning cloud services, and backup and recovery strategy.
• Own and evolve platform automation, including Infrastructure as Code (Terraform) and Azure DevOps CI/CD pipelines for Databricks and dependent cloud resources.
• Monitor system performance and troubleshoot issues related to Databricks clusters, jobs, and data pipelines.
• Implement best practices for security, compliance, and cost management within Azure Databricks environments.
• Collaborate with data engineers, data scientists, and other stakeholders to support their workflows and optimize platform usage, including Power BI and dashboard administration.
• Partner with cloud networking and security teams to design and operate secure connectivity patterns (VNets/subnets, routing/DNS, Private Link, VNet injection), especially for environments isolated from the public internet.
• Integrate Databricks with various SaaS products and services, ensuring seamless data flow and interoperability.
• Administer and maintain Power BI workspaces, datasets, and reports, ensuring effective data visualization and reporting capabilities.
• Automate routine administrative tasks using scripting (Python and/or Bash) and Databricks REST APIs.
• Manage data access controls, auditing, and monitoring to maintain data integrity and privacy.
• Stay current with new features, updates, and best practices in Databricks, Azure, and relevant SaaS platforms.
• Document procedures, configurations, and troubleshooting steps for internal knowledge sharing.

What You Bring To The Table

• Bachelor’s degree in Computer Science, Information Technology, or a related field (or equivalent experience).
• Proven experience administering Azure Databricks (or cross-cloud equivalent), including workspace setup, cluster management, and performance tuning.
• Solid understanding of Azure cloud services (e.g., Azure Data Lake, Azure Synapse Analytics, Entra, Azure DevOps).
• Proficiency with Infrastructure as Code using Terraform (preferred), and experience working with CI/CD pipelines to deploy and manage cloud resources.
• Working knowledge of cloud infrastructure concepts—storage, networking, and identity and access management (IAM)—including applied experience with VNets/subnets and Private Link (or cross-cloud equivalents).
• Experience integrating and managing SaaS products within a cloud-based data ecosystem.
• Strong scripting and automation skills (Python and/or Bash).
• Knowledge of big data concepts, Spark architecture, and ETL processes.
• Familiarity with data security, compliance, and governance best practices.
• Agility, innovation, responsiveness and a continuous improvement mindset through proactive problem-solving and ownership of outcomes.
• Able to effectively manage competing demands, rapidly shifting priorities, and high-pressure moments.
• Relevant certifications (e.g., Azure Administrator, Databricks Certified Associate) are a plus.

EEO Statement

We are an equal opportunity employer. BrokerLink is committed to providing an accessible environment. Accommodations are available on request for candidates taking part in the selection process. BrokerLink is committed to creating an inclusive environment which embraces our diversities and sees them as our strength!