ETL Quality Engineer — ADB Pipelines & Automation

Compunnel, Inc.; Toronto; On-site; CAD 70,000 - 90,000; Full time

Job summary

A tech firm in Canada is seeking a Quality Engineer to test ETL pipelines, design functional test cases, and support automation initiatives. The ideal candidate should have strong skills in SQL, Python, and PySpark, with experience in ADB environments. The role involves collaboration with cross-functional teams to deliver high-quality outcomes in a fast-paced setting.

Qualifications

• Hands-on experience in ETL pipeline testing within ADB environments.
• Strong proficiency in SQL for data validation and query optimization.
• Experience with Python and PySpark for test automation and data processing.
• Familiarity with test design techniques and automated testing frameworks.
• Ability to collaborate effectively with cross-functional teams and communicate clearly.
• Strong organizational skills and ability to work autonomously under tight deadlines.

Responsibilities

• Collaborate with PO, BSA, and POD teams to understand business requirements and create comprehensive test plans and test cases.
• Design effective test scenarios using automated approaches and test design techniques.
• Leverage existing automation frameworks to ensure continuous testing processes.
• Execute functional and ETL pipeline testing in ADB environments.
• Create and manage defects in JTMF and participate in triage sessions.
• Actively support automation initiatives and work closely with automation teams.
• Provide assistance to QE Lead/QE Manager with tasks and ad hoc requests.
• Work independently in a fast-paced environment ensuring quality and compliance standards.

Skills

SQL

Python

PySpark

ETL pipeline testing

Collaboration

Test design techniques

Automation

Organizational skills

Job description

The Quality Engineer will be responsible for testing ETL pipelines in an ADB environment, designing functional test cases, and supporting automation initiatives.

This role requires strong technical skills in SQL, Python, and PySpark, along with the ability to work collaboratively with product owners, business analysts, and development teams to ensure high-quality deliverables.

Key Responsibilities

• Collaborate with PO, BSA, and POD teams to understand business requirements and create comprehensive test plans and test cases.
• Design effective test scenarios using automated approaches and test design techniques.
• Leverage existing automation frameworks, tools, and artifacts to ensure continuous and autonomous testing processes.
• Execute functional and ETL pipeline testing in ADB environments.
• Create and manage defects in JTMF and participate in triage sessions.
• Actively support automation initiatives and work closely with automation teams.
• Provide assistance to QE Lead/QE Manager with tasks and ad hoc requests as needed.
• Work independently in a fast-paced environment while ensuring quality and compliance standards.

Required Qualifications

• Hands-on experience in ETL pipeline testing within ADB environments.
• Strong proficiency in SQL for data validation and query optimization.
• Experience with Python and PySpark for test automation and data processing.
• Familiarity with test design techniques and automated testing frameworks.
• Ability to collaborate effectively with cross-functional teams and communicate clearly.
• Strong organizational skills and ability to work autonomously under tight deadlines.

Preferred Qualifications

• Experience with cloud-based data platforms and big data technologies.
• Exposure to Agile methodologies and continuous integration practices.

Email ID * This field is required Please enter valid emailId.

Cell phone * This field is required Please enter valid cell phone.

First Name * This field is required Please enter valid first name.

Last Name * This field is required Please enter valid last name.