Senior Data Engineer (Databricks Focused)

BDO Canada; Oakville; On-site; CAD 84,000 - 128,000; Full time

Job summary

BDO Canada is seeking a Senior Data Engineer (Databricks Focused) to join its Technology Advisory Services practice. This role combines technical leadership with hands-on data engineering, delivering scalable and production-grade data pipelines primarily using Azure and Databricks. The successful candidate will engage with clients to align data initiatives with business objectives.

The ideal candidate will have a strong background in data engineering, with at least 5 years of experience, including substantial work with Databricks. A competitive compensation range of $84,000 to $128,000 is offered for this position.

Qualifications

• Minimum 5 years of hands-on data engineering experience.
• At least 3 years working with Databricks and Apache Spark.
• Strong proficiency in Azure ecosystem and cloud platforms.

Responsibilities

• Design and optimize robust data pipelines using Databricks.
• Develop scalable ETL processes ensuring data quality.
• Lead client engagements and align data initiatives with business objectives.

Skills

Databricks

Apache Spark

Azure Data Lake

Python

CI/CD practices

Education

Bachelor’s or master’s degree in Computer Science or related discipline

Tools

Azure Databricks

GitHub Actions

Terraform

Job description

About BDO

BDO is a firm built on a foundation of positive relationships with our people and clients. Each day, our professionals provide exceptional service, helping clients with advice and insight they can trust. We offer an award‑winning environment that fosters a people‑first culture with a high priority on personal and professional growth.

Opportunity

BDO Digital seeks an experienced Senior Data Engineer (Databricks Focused) to join the Technology Advisory Services practice. The role blends technical leadership with hands‑on data engineering, focusing on delivering scalable, secure, and production‑grade data pipelines using Azure and Databricks. The successful candidate will also lead client engagements, aligning data initiatives with business objectives to create real‑world impact.

Key Responsibilities

• Design, build, and optimize robust data pipelines using Databricks, Delta Lake, and Apache Spark.
• Develop scalable ETL processes for structured and unstructured data, ensuring data quality and reliability.
• Implement data integration solutions across cloud and on‑premises sources, leveraging Databricks and Azure Data Lake.
• Automate data ingestion, transformation, and validation workflows.
• Monitor, troubleshoot, and enhance data pipeline performance and reliability.
• Ensure compliance, security, and operational excellence across all data workflows.
• Serve as a primary technical lead for client engagements focused on data engineering and analytics solution delivery.
• Translate business requirements into scalable data architectures and operational plans.
• Collaborate with cross‑functional teams to integrate data solutions into production environments.
• Mentor junior team members and promote adoption of best practices in data engineering and cloud analytics.
• Convert business requirements and analytics prototypes into robust, scalable data solutions.
• Apply appropriate data modeling and transformation techniques to support analytics and machine learning initiatives.
• Document data pipelines and contribute to internal knowledge sharing.

Qualifications

Required

• Educational Background: Bachelor’s or master’s degree in Computer Science, Data Engineering, Information Systems, or a closely related discipline. Strong foundation in data structures, algorithms, and distributed systems.
• Professional Experience: Minimum 5 years hands‑on data engineering, including at least 3 years with Databricks, Apache Spark, and cloud data platforms. Proven success deploying and maintaining large‑scale data solutions in production environments.
• In‑depth knowledge of the Microsoft Azure ecosystem, with demonstrated experience using Azure Data Lake, Azure Databricks, Azure Synapse, and Azure DevOps.
• Very strong proficiency with Databricks, including Delta Lake, Apache Spark, and pipeline orchestration. Experience optimizing performance and reliability in production.
• Advanced programming skills in Python and/or Scala, with practical experience using data engineering libraries and frameworks.
• Solid understanding of CI/CD practices, with experience designing and maintaining pipelines using GitHub Actions, Azure DevOps, or Jenkins. Familiarity with infrastructure‑as‑code tools such as Terraform or ARM templates for automation.
• Excellent written and verbal communication skills to engage stakeholders. Ability to explain technical concepts to non‑technical audiences and influence decision‑making.

Preferred

• Certifications: Databricks Certified Data Engineer or Microsoft Certified Azure Data Engineer Associate.
• Experience with data governance, data security, and compliance frameworks.
• Consulting experience and excellent client management skills.

Compensation range: $84,000 to $128,000.

If you require accommodation to complete the application process, please contact us.