Senior Data Engineer - Databricks & Azure Lead

BDO; Calgary; Hybrid; CAD 120,000 - 170,000; Full time

Job summary

BDO Digital is seeking an experienced Senior Data Engineer (Databricks focused) to join our Technology Advisory Services practice in Canada. This role blends technical leadership with hands-on data engineering to deliver scalable, secure data pipelines on Azure and Databricks.

You will lead client engagements and translate business needs into data architectures. Responsibilities include building robust ETL pipelines, ensuring data quality, mentoring junior staff, and promoting best practices in

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a closely related discipline.
• 5+ years hands-on data engineering with at least 3 years on Databricks, Spark, and cloud data platforms.
• Deep knowledge of the Microsoft Azure ecosystem (Azure Data Lake, Databricks, Synapse, DevOps).
• Strong Databricks proficiency with Delta Lake, Spark, and data pipeline orchestration; production experience.
• Proficient in Python and/or Scala; experience with data engineering libraries/frameworks.
• Understanding of CI/CD; pipelines with GitHub Actions, Azure DevOps, or Jenkins; IaC with Terraform/ARM.

Responsibilities

• Design, build, and optimize data pipelines using Databricks, Delta Lake, and Apache Spark.
• Develop scalable ETL processes for structured and unstructured data; ensure quality and reliability.
• Implement data integration across cloud and on‑prem sources using Databricks and Azure Data Lake.
• Automate ingestion, transformation, and validation workflows; monitor performance and reliability.
• Lead client engagements; translate business requirements into scalable data architectures; mentor juniors.

Skills

Databricks

Apache Spark

Python/Scala

CI/CD practices

Communication skills

Education

Bachelor’s or Master’s in Computer Science / Data Engineering / Information Systems

Tools

Databricks

Delta Lake

Azure Data Lake

Azure Synapse

Azure DevOps

Terraform

ARM templates

GitHub Actions

Jenkins

Job description

BDO Digital is seeking an experienced Senior Data Engineer (Databricks focused) to join our Technology Advisory Services practice in Canada. This role blends technical leadership with hands-on data engineering to deliver scalable, secure data pipelines on Azure and Databricks.

You will lead client engagements and translate business needs into data architectures. Responsibilities include building robust ETL pipelines, ensuring data quality, mentoring junior staff, and promoting best practices in