Azure Data QA Tester (Azure Databricks)

Ccube; Toronto; Hybrid; CAD 80,000 - 100,000; Full time

Job summary

A leading tech company is seeking an Azure Data QA Tester for a hybrid role in Toronto, ON. The ideal candidate will have over 5 years of experience in ETL and Data Testing, particularly with Azure Databricks and Azure Data Factory. Responsibilities include performing ETL testing on large-scale pipelines, validating data flow, and designing automated test frameworks. This position offers an engaging environment with a focus on data quality and innovation.

Qualifications

• 5+ years of experience in ETL / Data Testing projects.
• Strong hands-on experience with Azure Databricks.
• Working experience with Azure Data Factory.

Responsibilities

• Perform ETL testing on large-scale data pipelines built using Azure Databricks and Azure Data Factory.
• Validate data flow from multiple source systems to target databases.
• Test complex data transformation and consumer merge business rules.

Skills

ETL/Data Testing/Azure Databricks

SQL

Python/Py Spark

Tools

Azure Data Factory

Jira

TestRail

Git

SonarQube

Job description

Hello Data Tester Professional!

Hope you are doing well! We are looking for an Azure Data QA Tester in Toronto, ON for a Hybrid Role.

Below is the JD for review.

Job Title: Azure Data QA Tester (Azure Databricks)

Location: Toronto, ON (Hybrid)

Full Time: Full Time

Experience: 5-10+ Years

Must have:

• ETL/Data Testing/Azure Databricks + Azure Data Factory: 4 years (Required)
• Strong SQL + Python/Py Spark: 3 years (Required)

Job Description (Responsibilities)

• Perform ETL testing on large-scale data pipelines built using Azure Databricks and Azure Data Factory
• Validate data flow from multiple source systems to target databases
• Test complex data transformation and consumer merge business rules
• Execute API test scenarios and validate JSON/XML responses
• Write and execute complex SQL queries for data validation
• Perform data validation using SQL, Python, and PySpark
• Validate source, staging, and target tables in Databricks
• Design, build, and maintain automated test frameworks using PyTest
• Automate recurring data quality and regression test cases
• Log, track, and validate defects using Jira
• Create and manage test cases in TestRail
• Work closely with development teams to recreate and validate defects
• Participate in daily agile stand-ups and update task status in Jira
• Maintain code quality using Git and SonarQube

Required Skill Sets

• 5+ years of experience in ETL / Data Testing projects
• Strong hands-on experience with Azure Databricks
• Working experience with Azure Data Factory
• Excellent SQL skills with ability to write complex queries
• Strong experience in Python or PySpark for data validation
• Experience in test automation for data pipelines
• Knowledge of data formats such as JSON, Parquet, Avro
• Experience working with Git repositories, branches, and pull requests
• Familiar with Jira, TestRail, and Agile methodology
• Strong analytical and problem-solving skills
• Ability to work independently in a remote, fast-paced environment
• Quick learner with strong attention to data quality and accuracy