RQ09315 - Software Developer - ETL - Senior

Rubicon Path; Toronto; Hybrid; CAD 80,000 - 120,000; Full time

Job summary

A leading company is seeking a highly skilled Software Developer with extensive ETL implementation experience to join their data engineering team. This hybrid role involves ensuring the reliability and performance of data pipelines on the Microsoft Azure platform. Candidates should have a strong background in data engineering, automated testing, and public sector experience, with a focus on developing robust data quality frameworks and CI/CD processes.

Qualifications

• 5+ years in software development in the public sector.
• Strong experience with Microsoft Azure and Databricks.
• Expertise in automated testing and CI/CD practices.

Responsibilities

• Design and implement test plans for data pipelines.
• Conduct data quality assessments and validation.
• Collaborate with teams to ensure data integrity and performance.

Skills

ETL Implementation

Data Engineering

Automated Testing

Data Quality Assessment

CI/CD Processes

Agile Methodology

Education

Microsoft Certified: Azure Data Engineer Associate

Databricks Certified Data Engineer Associate/Professional

Microsoft Certified: Power BI Data Analyst Associate

Certified Software Tester (CSTE)

Tools

Azure DevOps

Git

Visual Studio Code

Power BI

JIRA

Selenium

JMeter

Job description

NOTE

Assignment Type: This position is currently listed as "Hybrid". Consultants will be required to work onsite at the work location 3 days a week and 2 days from home. The details of this arrangement will be confirmed with the Hiring Manager.

Extension/Amendment Attestation: Extensions are only allowed using unused days/funds left on the contract. No additional funds will be added beyond the maximum contract value. The Statement of Work (SOW) shall expire on April 2, 2026. HSC may exercise its option(s) to extend a SOW beyond April 2, 2026 using unused days/funds left on the contract, provided the Master Service Agreement is extended beyond April 5, 2026, and under the same terms, conditions, and covenants as the SOW.

===============================================================

Responsibilities:

We are seeking a highly skilled Software Developer with ETL implementation experience to join our data engineering team. This role is critical in ensuring the accuracy, reliability, and performance of our data pipelines and analytics infrastructure built on the Microsoft Azure platform and Databricks. Under the supervision of the IT QA Lead, you will collaborate closely with data engineers and DevOps teams to design and implement robust data quality frameworks, automated testing pipelines, and CI/CD processes.

• Design and implement comprehensive test plans for data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack.

• Conduct data quality assessments, validation, and profiling using tools like Great Expectations.

• Develop and maintain automated testing frameworks integrated into CI/CD pipelines.

• Collaborate with data engineers to ensure adherence to Medallion Architecture best practices.

• Monitor and assess pipeline performance, scalability, and data integrity.

• Implement and manage DevOps practices using Azure DevOps, Git, and related tools.

• Document test cases, validation rules, and QA processes clearly and consistently.

• Perform functional testing on Power BI Reports and dashboards.

• Participate in Agile ceremonies and contribute to sprint planning and retrospectives.

Skills, Experience, and Skill Set Requirements

Public Sector Experience:

• 5+ years of experience working in the federal/provincial/broader public sector as a software developer, data specialist, or quality assurance tester.

Core ETL Development Skills & Experience:

• 5+ years of experience in data engineering, designing and implementing data pipelines and transformations in a Microsoft Azure + Databricks and Power BI stack.

• Strong knowledge and hands-on experience with:

- Microsoft Azure Data Services (ADF, ADLS Gen 2, Synapse, Azure SQL)

- Azure Databricks

- PySpark and SQL

- Power BI (data preparation, modeling, and visualization)

• Demonstrated experience in developing and maintaining data pipelines and release management through CI/CD and DevOps practices using Azure DevOps, Git, and Visual Studio Code.

• Experience collaborating with data engineers to follow Medallion Architecture (Staging, Bronze, Silver, Gold layers).

• Certifications (preferred but not required):

- Microsoft Certified: Azure Data Engineer Associate

- Databricks Certified Data Engineer Associate/Professional

- Microsoft Certified: Fabric Analytics Engineer Associate

- Microsoft Certified: Power BI Data Analyst Associate

- Microsoft Certified: DevOps Engineer

Quality Assurance Skills & Experience:

• 5+ years in quality assurance and automated testing, including:

- Conducting software quality assessments, system testing, performance evaluation, and automated testing using tools such as JIRA or Azure DevOps, Selenium, and JMeter.

- Data quality assessments, validation, and profiling with tools like Great Expectations.

- Developing and maintaining automated testing frameworks integrated into CI/CD pipelines using Azure DevOps, Git, and Visual Studio Code.

• Certifications (preferred):

- Certified Software Tester (CSTE)

- Certified Tester Test Automation Engineer