Senior Data Engineer

TechDoQuest; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

TechDoQuest in Toronto is seeking a senior data analyst to lead data analysis, profiling, and migration assessment for BigQuery environments. You will map source to target datasets, review Airflow workflows, and define data quality requirements.

Collaborate with Business SMEs, Architects, and Engineering teams to validate migration outcomes, support UAT and data validation, and produce governance artifacts such as data dictionaries and lineage.

Qualifications

• Must have strong expertise in data analysis, data warehousing concepts, and analytics platforms.
• Experience with BigQuery, Airflow, and data mapping is essential.
• Proven ability to translate business requirements into data solutions.

Responsibilities

• Lead data analysis, profiling, discovery, and migration assessment activities.
• Perform source to target mapping for BigQuery datasets, pipelines, and reporting assets.
• Analyze Airflow/Composer workflows and downstream dependencies.
• Define migration, reconciliation, and data quality requirements.
• Collaborate with Business SMEs, Architects, and Engineering teams to validate migration outcomes.
• Support UAT, defect analysis, data validation, and migration sign off activities.
• Create data lineage, business rules, data dictionaries, and governance documentation.

Skills

GCP BigQuery

Apache Airflow / Cloud Composer

SQL & Data Analysis

Data Profiling & Data Mapping

Job description

Years of Experience: 7 10 Years

Responsibilities

• Lead data analysis, profiling, discovery, and migration assessment activities.
• Perform source to target mapping for BigQuery datasets, pipelines, and reporting assets.
• Analyze Airflow/Composer workflows and downstream dependencies.
• Define migration, reconciliation, and data quality requirements.
• Collaborate with Business SMEs, Architects, and Engineering teams to validate migration outcomes.
• Support UAT, defect analysis, data validation, and migration sign off activities.
• Create data lineage, business rules, data dictionaries, and governance documentation.

Mandatory Skills

• GCP BigQuery
• Apache Airflow / Cloud Composer
• SQL & Data Analysis
• Data Profiling & Data Mapping

Preferred Skills

• Strong understanding of Data Warehousing and Lakehouse concepts
• Experience with analytics platforms

Qualifications

• 9+ years of Data Analysis experience
• Strong understanding of Data Warehousing, Lakehouse, and Analytics platforms