RQ09315 - Software Developer - ETL - Senior

Rubicon Path; Toronto; Hybrid; CAD 90,000 - 120,000; Full time

Job summary

A leading technology consulting firm in Toronto, Canada is seeking a Senior Software Developer specialized in ETL. This hybrid position requires 5+ years of experience in data engineering with expertise in Microsoft Azure, Databricks, and Power BI. Responsibilities include designing data pipelines, developing automated testing frameworks, and ensuring data integrity in a collaborative environment. Ideal candidates should possess strong skills in PySpark, SQL, and quality assurance processes.

Qualifications

• 5+ years of experience in data engineering and quality assurance.
• Strong proficiency in designing data pipelines and transformations.
• Hands-on experience with tools used for automated testing.

Responsibilities

• Design and implement test plans for data pipelines.
• Develop and maintain automated testing frameworks.
• Monitor and assess pipeline performance and data integrity.

Skills

Experience in federal/provincial/broader public sector

Data engineering with Microsoft Azure, Databricks, Power BI

PySpark

SQL

Power BI (data preparation, modelling, visualization)

Automated testing using Selenium

Tools

Azure DevOps

Git

Visual Studio Code

JIRA

JMeter

Job description

RQ09315 - Software Developer - ETL - Senior

About the job RQ09315 - Software Developer - ETL - Senior

NOTE

Assignment Type: This position is currently listed as "Hybrid" and consultants will be required to work onsite at the work location 3 days a week and 2 days from home. The details of this arrangement will be confirmed with the Hiring Manager.

Extension/Amendment Attestation: Extension(s) only allowed using unused days/funds left on contract. No additional funds will be added beyond maximum contract value. The Statement of Work (SOW) shall expire on April 2, 2026. HSC may exercise its option(s) to extend a SOW beyond April 2, 2026 using unused days/funds left on the contract. Such extension(s) will be allowable only if the Master Service Agreement is extended beyond April 5, 2026 and be upon the same terms, conditions and covenants contained in the SOW.

===============================================================

Responsibilities

We are seeking a highly skilled Software Developer with ETL implementation experience to join our data engineering team. This role is critical in ensuring the accuracy, reliability, and performance of our data pipelines and analytics infrastructure built on the Microsoft Azure platform and Databricks. Under the supervision of the IT QA Lead, you will collaborate closely with data engineers and DevOps teams to design and implement robust data quality frameworks, automated testing pipelines, and CI/CD processes.

• Design and implement comprehensive test plans for data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack.
• Conduct data quality assessments, validation, and profiling using tools like Great Expectations.
• Develop and maintain automated testing frameworks integrated into CI/CD pipelines.
• Collaborate with data engineers to ensure adherence to Medallion Architecture best practices.
• Monitor and assess pipeline performance, scalability, and data integrity.
• Implement and manage DevOps practices using Azure DevOps, Git, and related tools.
• Document test cases, validation rules, and QA processes clearly and consistently.
• Perform functional testing on Power BI Reports and dashboards.
• Participate in Agile ceremonies and contribute to sprint planning and retrospectives.

Skills, Experience and Skill Set Requirements

Public Sector Experience

• 5+ years of experience working in the federal/provincial/broader public-sector as a software developer, data specialist, or quality assurance tester.

Core ETL Development Skill & Experience

5+ years of experience in data engineering:

• Design and implement comprehensive data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack.
• Strong knowledge and hands‑on experience with PySpark and SQL.
• Strong knowledge and hands‑on experience with Power BI (data preparation, modelling, and visualization).
• Experience developing and maintaining data pipelines and release management through Continuous Integration and Continuous Delivery (CI/CD) and DevOps practices using Azure DevOps, Git, Visual Studio Code, and related tools.
• Experience collaborating with data engineers to ensure adherence to Medallion Architecture best practices (Staging, Bronze, Silver, Gold layers).

Certifications (preferred but not required):

• Microsoft Certified: Fabric Analytics Engineer Associate
• Microsoft Certified: Power BI Data Analyst Associate

Quality Assurance Skill & Experience

5+ years of experience in quality assurance and automated testing:

• Conduct software quality functional assessments, systems testing, performance evaluation, and automated testing using tools such as JIRA or Azure DevOps for defect tracking, Selenium for automated testing of web‑based apps (including Power BI reports and dashboards), and JMeter for performance evaluation.
• Conduct data quality assessments, validation, and profiling using tools like Great Expectations.
• Develop and maintain automated testing frameworks integrated into CI/CD pipelines and DevOps practices using Azure DevOps, Git, Visual Studio Code, and related tools.

Certifications (preferred but not required):

• Certified Software Tester (CSTE)
• Certified Tester Test Automation Engineer

MUST HAVE

5+ years of experience in data engineering:

• Design and implement comprehensive data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack.
• Strong knowledge and hands‑on experience with PySpark and SQL.
• Strong knowledge and hands‑on experience with Power BI (data preparation, modelling, and visualization).
• Experience developing and maintaining data pipelines and release management through Continuous Integration and Continuous Delivery (CI/CD) and DevOps practices using Azure DevOps, Git, Visual Studio Code, and related tools.

Experience conducting software quality functional assessments, systems testing, performance evaluation, and automated testing using tools such as JIRA or Azure DevOps for defect tracking, Selenium for automated testing of web‑based apps (including Power BI reports and dashboards), and JMeter for performance evaluation.

• Conducting data quality assessments, validation, and profiling using tools like Great Expectations.
• Developing and maintaining automated testing frameworks integrated into CI/CD pipelines and DevOps practices using Azure DevOps, Git, Visual Studio Code, and related tools.