11543

Zohorecruit; Toronto; On-site; CAD 120,000 - 160,000; Full time

Job summary

Zohorecruit is seeking a Senior Data Architect to lead architecture and implementation of advanced analytics on Azure Databricks and Microsoft Fabric in Toronto. You will drive end-to-end data pipelines, mentor the team, and ensure governance and security across data platforms.

Required 12+ years in data ingestion/transformation, strong SQL, PySpark, Delta Lake, and experience with Azure Synapse and Power BI. Fluent French is mandatory for this role.

Qualifications

• Demonstrated expertise of 12 years in building data ingestion and transformation pipelines with Databricks/Synapse notebooks and Azure Data Factory.
• Solid understanding and hands-on experience with Delta Lake and Azure Data Lake Storage Gen2.
• Experience with Auto Loader and Delta Live Tables for seamless data ingestion and transformation.
• Proficiency in Databricks SQL for query optimization and data access layers.
• Familiarity with modern CI/CD practices in cloud-native data platforms.
• Mandatory French-speaking capability.

Responsibilities

• Lead the architecture, design, and implementation of advanced analytics solutions using Azure Databricks and Microsoft Fabric.
• Oversee end-to-end data solution delivery aligned with business requirements and governance standards.
• Mentor and guide the data engineering team to foster continuous learning and best practices.
• Document architecture, processes, and data flows for security and compliance.
• Collaborate with stakeholders and IT to translate requirements into scalable data pipelines.

Skills

Azure Databricks

Microsoft Fabric

SQL

PySpark

Delta Lake

Spark

Power BI

Data Pipelines

Data Modeling

CI/CD

Git

Hadoop

NoSQL

Azure Synapse

Azure Data Factory

Delta Live Tables

Auto Loader

Notebook Development

Tools

Azure Data Factory

Azure Synapse

Job description

• Lead the architecture, design, and implementation ofadvanced analytics solutions using Azure Databricks and Microsoft Fabric.
  
• Apply deep expertise in big data technologies, dataengineering, cloud computing, Azure Databricks, and strong SQL skills todeliver scalable solutions.
  
• Work closely with business stakeholders and IT teams tounderstand requirements and deliver effective, business-aligned solutions.
  
• Oversee end-to-end implementation of data solutions,ensuring alignment with business requirements and industry best practices.
  
• Lead the development of data pipelines and ETL processesusing Azure Databricks, PySpark, and other relevant tools.
  
• Integrate Azure Databricks with Azure services such as AzureData Lake, Azure Synapse, Azure Data Factory, and on-premises systems.
  
• Provide expertise in Spark; Scala experience is an addedadvantage.
  
• Demonstrate strong Microsoft Fabric expertise, includingpipeline development, notebook development, semantic modelling, real-timeintelligence, and related scenarios.
  
• Provide technical leadership and mentorship to the dataengineering team, fostering a culture of continuous learning and improvement.
  
• Ensure proper documentation of architecture, processes, anddata flows while maintaining compliance with security and governance standards.
  
• Promote best practices for code quality, data security,scalability, and maintainability.
  
• Stay current with the latest developments in Databricks andassociated technologies to support continuous innovation.
  
• Mandatory French-speaking capability.
  
• Strong experience with Azure Databricks, including clustermanagement, notebook development, and Delta Lake.
  
• Proficiency in big data technologies such as Hadoop andSpark, along with data processing frameworks such as PySpark.
  
• Experience with Power BI, SSRS, SSAS, and SKU migration fromP-SKU to F-SKU.
  
• Experience with ETL/ELT processes, data warehousing, anddata lake development.
  
• Strong SQL skills and familiarity with NoSQL databases.
  
• Experience with CI/CD pipelines and version control systemssuch as Git.
  
• Knowledge of cloud security best practices.
  

Requirements

Soft Skills

• Mandatory French-speaking capability.
  
• Excellent communication skills, with the ability to explaincomplex technical concepts to non-technical stakeholders.
  
• Strong problem-solving skills and a proactive approach toidentifying and resolving issues.
  
• Leadership skills, with the ability to manage and mentor ateam of data engineers.
  

Nice-to-Have Skills

• Power BI experience for dashboarding and reporting.
  
• Microsoft Fabric experience for analytics and integrationtasks.
  
• Spark Streaming experience for processing real-time datastreams.
  
• Familiarity with Azure Resource Manager templates forinfrastructure as code practices.
  

Experience

• Demonstrated expertise of 12 years in developing dataingestion and transformation pipelines using Databricks/Synapse notebooks andAzure Data Factory.
  
• Solid understanding and hands-on experience with Deltatables, Delta Lake, and Azure Data Lake Storage Gen2.
  
• Experience using Auto Loader and Delta Live Tables forseamless data ingestion and transformation.
  
• Proficiency in building and optimizing query layers usingDatabricks SQL.
  
• Demonstrated experience integrating Databricks with AzureSynapse, ADLS Gen2, and Power BI for end-to-end analytics solutions.
  
• Prior experience developing, optimizing, and deploying PowerBI reports.
  
• Familiarity with modern CI/CD practices, especially in thecontext of Databricks and cloud-native solutions.