Senior Data Architect

TechDoQuest; Toronto; On-site; CAD 140,000 - 190,000; Full time

Job summary

TechDoQuest in Toronto, Ontario seeks an experienced Data Architect to lead the architecture and modernization of enterprise data platforms during a large migration from Google BigQuery/GCP to Azure Databricks. You will define the target-state architecture and migration strategy while implementing governance and a Lakehouse architecture with Delta Lake.

Responsibilities include designing the Azure Databricks Lakehouse, leading the Bronze-Silver-Gold data models, and collaborating with business

Qualifications

• 15+ years of experience in Data & Analytics.
• 5+ years of experience in Data Architecture.
• Preferred certifications include: Microsoft Azure Solutions Architect Expert

Responsibilities

• Define the Azure Databricks Lakehouse architecture and create a comprehensive migration roadmap.
• Design and implement Medallion Architecture (Bronze, Silver, Gold) and Delta Lake solutions.
• Lead the architecture for the BigQuery-to-Databricks migration, including source-to-target mapping.
• Establish governance, security, and data management standards utilizing Unity Catalog.
• Architect scalable data models, ingestion frameworks, and analytics platforms to support business needs.
• Collaborate with business, engineering, and program teams to deliver cloud modernization initiatives effectively.

Skills

Azure Databricks

PySpark

SQL

Data Modeling

Data Migration

Modernization

Azure DevOps

CI/CD

Tools

Unity Catalog

Azure Data Factory

ADLS Gen2

Job description

We are seeking an experienced Data Architect to lead the architecture and modernization of our enterprise data platforms. This role is critical as we undertake a large-scale migration from Google BigQuery/GCP to Azure Databricks. The Data Architect will be responsible for defining the target-state architecture, developing the migration strategy, implementing data governance, and executing the Lakehouse architecture for a strategic data transformation program.

Responsibilities

• Define the Azure Databricks Lakehouse architecture and create a comprehensive migration roadmap.
• Design and implement Medallion Architecture (Bronze, Silver, Gold) and Delta Lake solutions.
• Lead the architecture for the BigQuery-to-Databricks migration, including source-to-target mapping.
• Establish governance, security, and data management standards utilizing Unity Catalog.
• Architect scalable data models, ingestion frameworks, and analytics platforms to support business needs.
• Collaborate with business, engineering, and program teams to deliver cloud modernization initiatives effectively.

Mandatory Skills

• Expertise in Azure Databricks, including Delta Lake and Lakehouse Architecture.
• Proficient in PySpark and SQL.
• Strong background in Data Modeling (Dimensional/Data Vault), Data Migration, and Modernization.
• Experience with Azure Data Factory and ADLS Gen2.
• Familiarity with CI/CD processes and Azure DevOps.

Preferred Skills

• Experience with BigQuery migration.
• Financial Services industry experience is preferred.

Qualifications

• 15+ years of experience in Data & Analytics.
• 5+ years of experience in Data Architecture.
• Preferred certifications include:
• Microsoft Azure Solutions Architect Expert