Senior Data Engineer - Toronto, Scalable Data Pipelines

CoStar Realty Information, Inc.; Toronto; On-site; CAD 120,000 - 150,000; Full time

Benefits offered by this job

Comprehensive healthcare

401(k) match

Tuition reimbursement

On-site fitness center

Job summary

CoStar Group in Toronto, Ontario, seeks a Senior Data Engineer to design, build, and operate reliable, scalable data pipelines on a modern cloud data platform. This hands-on role focuses on data pipeline development, performance optimization, production reliability, and continuous improvement, using Python, SQL, dbt, Airflow, and Snowflake with AWS services.

The position requires 6+ years of data engineering experience and offers collaboration with product teams and a strong focus on automation

Qualifications

• 6+ years of professional experience in data engineering or a closely related discipline.
• Strong Python development skills for data pipelines, automation, integrations, and supporting data applications.
• Advanced SQL skills and experience working with large-scale datasets.
• Experience with dbt, including model development, dependency management, testing, incremental processing, and production deployment.
• Experience with Airflow, including DAG development, orchestration, dependencies, retries, failure handling, scheduling, and production operations.
• Hands-on PostgreSQL experience, including complex SQL development, database design, indexing, query optimization, and performance tuning.
• Hands-on Snowflake experience in production data workloads context.
• Experience working with AWS data services such as S3, RDS/Aurora, Glue, MWAA, IAM, and CloudWatch.
• Experience implementing automated data validation and quality controls.
• Experience with Git, pull requests, code review, conflict resolution and CI/CD workflows.
• Demonstrated ability to troubleshoot complex production pipeline and data issues.
• Understanding of monitoring, failure recovery, and production support practices.

Responsibilities

• Design, build, test, and maintain scalable data pipelines and data products.
• Develop and optimize data transformations and orchestrations using SQL, Python, dbt, Airflow, Glue, PostgreSQL, and Snowflake.
• Translate business requirements into maintainable technical designs and production-ready solutions.
• Implement automated testing, data-quality checks, monitoring, failure handling, and recovery.
• Optimize large-scale data workloads for performance, scalability, and cost.
• Troubleshoot production issues and perform root-cause analysis across pipelines and databases.
• Follow Git-based development, code review, CI/CD, and controlled release practices.
• Ensure data products are documented, observable, governed, and supported by appropriate metadata and lineage.
• Reduce technical debt, manual processes, and recurring operational issues through automation and improved design.
• Collaborate with Product Management, Application Engineering and business stakeholders.

Skills

Python

SQL

dbt

Airflow

PostgreSQL

Snowflake

AWS data services

data modeling

production deployment

Git/CI‑CD

Tools

dbt

Airflow

PostgreSQL

Snowflake

AWS Glue

MWAA

Job description

CoStar Group in Toronto, Ontario, seeks a Senior Data Engineer to design, build, and operate reliable, scalable data pipelines on a modern cloud data platform. This hands-on role focuses on data pipeline development, performance optimization, production reliability, and continuous improvement, using Python, SQL, dbt, Airflow, and Snowflake with AWS services.

The position requires 6+ years of data engineering experience and offers collaboration with product teams and a strong focus on automation