Software Developer ETL 9315-3009

Foilcon; Toronto; Hybrid; CAD 80,000 - 120,000; Full time

Job summary

A leading IT services and consulting company is seeking a Software Developer ETL for a hybrid contract role in Toronto. The successful candidate will design and implement data pipelines, conduct data quality assessments, and develop automated testing frameworks. This mid-senior level position requires extensive experience in data engineering, Azure, and QA testing, along with strong collaboration skills in an Agile environment.

Qualifications

• 5+ years in federal/provincial/public-sector as a software developer or data specialist.
• 5+ years in data engineering with expertise in Azure, Databricks, Power BI.
• 5+ years in QA and automated testing with CI/CD experience.

Responsibilities

• Design and implement test plans for data pipelines using Azure and Power BI.
• Conduct data quality assessments and develop automated testing frameworks.
• Collaborate with data engineers and participate in Agile ceremonies.

Skills

Data Engineering

Automated Testing

Data Quality Assessment

DevOps Practices

Agile Methodology

Education

Microsoft Certified: Azure Data Engineer Associate

Databricks Certified Data Engineer

Tools

JIRA

Selenium

JMeter

Great Expectations

Azure DevOps

Git

Visual Studio Code

Job description

Join to apply for the Software Developer ETL 9315-3009 role at Foilcon

HM Note: This hybrid contract role requires three (3) days in the office. Candidates' resumes must include their first and last names.

Description

Responsibilities:

• Design and implement comprehensive test plans for data pipelines and transformations using Microsoft Azure, Databricks, and Power BI.
• Conduct data quality assessments, validation, and profiling with tools like Great Expectations.
• Develop and maintain automated testing frameworks integrated into CI/CD pipelines.
• Collaborate with data engineers to adhere to Medallion Architecture best practices.
• Monitor pipeline performance, scalability, and data integrity.
• Implement DevOps practices with Azure DevOps, Git, and related tools.
• Document test cases, validation rules, and QA processes clearly.
• Perform functional testing on Power BI reports and dashboards.
• Participate in Agile ceremonies and contribute to sprint planning and retrospectives.

Skills

Experience and Skill Set Requirements

Public Sector Experience: 5+ years in federal/provincial/public-sector as a software developer, data specialist, or QA tester.

Core ETL Development Skills: 5+ years in data engineering with expertise in:

• Designing and implementing data pipelines in Azure, Databricks, Power BI.
• Microsoft Azure Data Services (ADF, ADLS Gen 2, Synapse, Azure SQL).
• Azure Databricks, PySpark, SQL.
• Power BI (data prep, modeling, visualization).
• CI/CD and DevOps practices with Azure DevOps, Git, Visual Studio Code.
• Adherence to Medallion Architecture (Staging, Bronze, Silver, Gold).

Certifications (preferred): Microsoft Certified: Azure Data Engineer Associate, Databricks Certified Data Engineer, etc.

Quality Assurance Skills & Experience:

5+ years in QA and automated testing with tools like JIRA, Selenium, JMeter, Great Expectations, and experience in CI/CD pipelines.

Certifications (preferred): CSTE, Test Automation Engineer.

Must Haves:

• 5+ years in data engineering with expertise in Azure, Databricks, Power BI.
• Experience with CI/CD, DevOps, automated testing, and data quality assessments.

Additional Details

• Seniority level: Mid-Senior level
• Employment type: Contract
• Job function: Engineering and IT
• Industries: IT Services and Consulting