Senior Databricks Data Engineer on Azure

BDO; Vancouver; On-site; CAD 84,000 - 128,000; Full time

Job summary

BDO Digital seeks an experienced Senior Data Engineer focused on Databricks to lead and deliver scalable data pipelines in Azure. You will own data integration, pipeline reliability, and production-grade solutions while guiding client engagements and mentoring junior engineers.

You will work across Databricks, Delta Lake, Spark, and cloud data platforms, ensuring robust data governance, security, and scalable architectures that align with business goals and analytics initiatives.

Qualifications

• Bachelor’s or master’s degree in Computer Science, Data Engineering, Information Systems, or similar.
• 5+ years hands-on data engineering experience, with at least 3 years in Databricks, Spark, and cloud data platforms.
• Deep knowledge of Microsoft Azure services (Azure Data Lake, Azure Databricks, Synapse, Azure DevOps).

Responsibilities

• Design, build, and optimize data pipelines using Databricks, Delta Lake, and Spark.
• Develop scalable ETL processes for structured and unstructured data.
• Lead client engagements and translate business requirements into scalable data architectures.
• Mentor junior engineers and promote best practices in cloud analytics and data engineering.

Skills

Databricks

Apache Spark

Python/Scala

CI/CD

Azure

Data engineering

Education

Bachelor's or Master's in CS/Data Eng

Tools

Azure Databricks

Delta Lake

GitHub Actions

Terraform

Job description

BDO Digital seeks an experienced Senior Data Engineer focused on Databricks to lead and deliver scalable data pipelines in Azure. You will own data integration, pipeline reliability, and production-grade solutions while guiding client engagements and mentoring junior engineers.

You will work across Databricks, Delta Lake, Spark, and cloud data platforms, ensuring robust data governance, security, and scalable architectures that align with business goals and analytics initiatives.