ETL Automation Quality Engineer - Data Integrity, AWS CI/CD

Tata Consultancy Services; Toronto; On-site; CAD 90,000 - 110,000; Full time

Job summary

Tata Consultancy Services Canada Inc. is seeking a detail-oriented ETL Automation Quality Engineer to ensure reliability and accuracy of data pipelines in a cloud-based environment.

You will design automated test frameworks, validate data across databases and data lakes, and develop Python scripts for testing, monitoring, and reporting. The role requires strong SQL, Python, ETL testing, Unix/Linux experience, and familiarity with AWS S3, Hadoop, and Parquet.

Qualifications

• Strong SQL expertise with data validation and complex query development.
• Proficiency in Python scripting for automation and testing.
• Experience with ETL testing and automation frameworks.
• Hands-on experience with Unix/Linux environments.
• Experience with AWS cloud services, including AWS S3.
• Knowledge of Hadoop, Parquet, and large-scale data platforms.
• Experience using GitHub and GitHub Actions for CI/CD.
• Strong understanding of Quality Engineering principles and testing methodologies.
• Experience in defect tracking, root cause analysis, and test planning.

Responsibilities

• Design, develop, and maintain automated test frameworks for ETL workflows.
• Validate data accuracy, consistency, and integrity across databases and data lakes.
• Write complex SQL queries to test data transformations and quality.
• Develop Python-based automation scripts for testing, monitoring, and reporting.
• Integrate automated testing into CI/CD pipelines using GitHub and GitHub Actions.
• Manage and validate data processing workflows in AWS environments, including AWS S3.
• Apply quality engineering methodologies, including test planning, risk analysis, and defect tracking.
• Develop and execute test cases for ETL processes and end-to-end data workflows.
• Validate API integrations and data exchanges where applicable.
• Document test strategies, test results, and improvement recommendations.
• Collaborate with cross-functional teams to troubleshoot data issues and optimize ETL processes.

Skills

Strong SQL

Python scripting

ETL testing

Unix/Linux

AWS S3

Data quality

Analytical skills

Communication

Tools

GitHub

GitHub Actions

Hadoop

Parquet

CI/CD

Job description

Tata Consultancy Services Canada Inc. is seeking a detail-oriented ETL Automation Quality Engineer to ensure reliability and accuracy of data pipelines in a cloud-based environment.

You will design automated test frameworks, validate data across databases and data lakes, and develop Python scripts for testing, monitoring, and reporting. The role requires strong SQL, Python, ETL testing, Unix/Linux experience, and familiarity with AWS S3, Hadoop, and Parquet.