Senior Azure Data QA - Data Pipelines, Databricks & CI/CD

Compunnel, Inc.; Toronto; On-site; CAD 90,000 - 115,000; Full time

Job summary

A leading tech firm in Toronto is seeking an experienced Azure Data QA with over 7 years of expertise in validating data pipelines across Azure and Databricks. Responsibilities include developing test strategies, detailed data validation, and supporting CI/CD integrations. Ideal candidates will have strong experience in Azure Data Factory, SQL, and Python, along with familiarity with data quality frameworks. This position offers a dynamic environment to ensure data integrity across cloud-based platforms.

Qualifications

• 7+ years of experience in Data Quality Assurance and Testing within cloud-based data ecosystems.
• Strong hands-on experience with Azure Data Factory (ADF) and Databricks.
• Proficiency in SQL and scripting languages such as Python.

Responsibilities

• Develop and implement test strategies, test cases, and automation scripts.
• Perform detailed data validation and comparative analysis between source and target systems.
• Collaborate with Data Engineers to understand Source-to-Target Mapping.

Skills

Data Quality Assurance

Azure Data Factory

Databricks

SQL

Python

Data Profiling

Transformation Logic

CI/CD Integration

Education

Bachelor’s degree in Computer Science, Information Systems, or related field

Tools

Azure DevOps

GitHub Actions

Job description

A leading tech firm in Toronto is seeking an experienced Azure Data QA with over 7 years of expertise in validating data pipelines across Azure and Databricks. Responsibilities include developing test strategies, detailed data validation, and supporting CI/CD integrations. Ideal candidates will have strong experience in Azure Data Factory, SQL, and Python, along with familiarity with data quality frameworks. This position offers a dynamic environment to ensure data integrity across cloud-based platforms.