Senior Data Quality Engineer: End-to-End Data Validation

Socket.dev; Toronto; On-site; CAD 120,000 - 150,000; Full time

Benefits offered by this job

Healthcare coverage

401K match

Employee stock purchase plan

Tuition reimbursement

Job summary

CoStar Group in Toronto, ON is seeking a Senior Data Quality Engineer to build and operate testing and validation capabilities that ensure data is accurate, complete, and fit for business use.

You will own end-to-end data pipeline testing, automated validation, test-data management, and business-rule verification, partnering with Product, Research, Economics, data engineers and SMEs to translate definitions into measurable tests.

Qualifications

• 6+ years of experience in Data Quality Engineering, Data Testing, Quality Engineering, Data Engineering, or a related discipline.
• Strong hands-on experience with ETL/ELT and end-to-end data pipeline testing.
• Strong experience with source-to-target reconciliation, regression testing, and large-dataset validation.
• Advanced SQL skills for data analysis, reconciliation, comparison, and validation.
• Strong scripting or test-automation skills, preferably Python.
• Experience designing automated data-testing or data-quality frameworks.
• Experience creating test cases, expected results, and curated test datasets for complex data scenarios.
• Experience validating data in modern cloud data platforms; Snowflake experience is preferred.

Responsibilities

• Design and execute testing strategies for ETL/ELT pipelines, transformations, integrations, and published data products.
• Validate data end to end, from source ingestion through transformation and final output.
• Perform source-to-target reconciliation to validate completeness, accuracy, mappings, calculations, aggregations, joins, filters, and business rules.
• Build regression coverage to detect unintended changes caused by pipeline, schema, transformation, or business-rule updates.
• Test large datasets using sampling, aggregate reconciliation, and edge cases.
• Partner with business SMEs to translate domain requirements into executable test scenarios.

Skills

Data quality engineering

SQL

Python

ETL/ELT testing

Data pipelines

Validation

Tools

Snowflake

dbt

Apache Airflow

AWS Glue

S3

DataHub

Grafana

CloudWatch

Job description

CoStar Group in Toronto, ON is seeking a Senior Data Quality Engineer to build and operate testing and validation capabilities that ensure data is accurate, complete, and fit for business use.

You will own end-to-end data pipeline testing, automated validation, test-data management, and business-rule verification, partnering with Product, Research, Economics, data engineers and SMEs to translate definitions into measurable tests.