Senior ETL Engineer — Azure Databricks & Power BI

Rubicon Path; Toronto; Hybrid; CAD 90,000 - 120,000; Full time

Job summary

A leading technology consulting firm in Toronto, Canada is seeking a Senior Software Developer specialized in ETL. This hybrid position requires 5+ years of experience in data engineering with expertise in Microsoft Azure, Databricks, and Power BI. Responsibilities include designing data pipelines, developing automated testing frameworks, and ensuring data integrity in a collaborative environment. Ideal candidates should possess strong skills in PySpark, SQL, and quality assurance processes.

Qualifications

• 5+ years of experience in data engineering and quality assurance.
• Strong proficiency in designing data pipelines and transformations.
• Hands-on experience with tools used for automated testing.

Responsibilities

• Design and implement test plans for data pipelines.
• Develop and maintain automated testing frameworks.
• Monitor and assess pipeline performance and data integrity.

Skills

Experience in federal/provincial/broader public sector

Data engineering with Microsoft Azure, Databricks, Power BI

PySpark

SQL

Power BI (data preparation, modelling, visualization)

Automated testing using Selenium

Tools

Azure DevOps

Git

Visual Studio Code

JIRA

JMeter

Job description

A leading technology consulting firm in Toronto, Canada is seeking a Senior Software Developer specialized in ETL. This hybrid position requires 5+ years of experience in data engineering with expertise in Microsoft Azure, Databricks, and Power BI. Responsibilities include designing data pipelines, developing automated testing frameworks, and ensuring data integrity in a collaborative environment. Ideal candidates should possess strong skills in PySpark, SQL, and quality assurance processes.