Specialist - Architecture

Maarut; Toronto; On-site; CAD 150,000 - 190,000; Full time

Job summary

Maarut is seeking a senior data architect to lead architecture, design, and implementation of advanced analytics using Azure Databricks and Microsoft Fabric. You will work with business stakeholders and IT teams to deliver scalable data pipelines and governance.

You will oversee end-to-end solutions, mentor the data engineering team, ensure security/compliance, and stay current with Databricks, Synapse, and related technologies.

Qualifications

• Mandatory French-speaking capability.
• Excellent communication skills to explain complex concepts.
• Strong leadership and mentorship abilities.
• 12+ years of data engineering/analytics experience.

Responsibilities

• Lead the architecture, design, and implementation of advanced analytics solutions using Azure Databricks and Microsoft Fabric.
• Oversee end-to-end data solutions aligned with business needs and best practices.
• Develop data pipelines and ETL processes with Databricks, PySpark, and related tools.
• Integrate Databricks with Azure services (Data Lake, Synapse, Data Factory) and on-prem systems.
• Provide technical leadership and mentorship to the data engineering team.
• Document architecture, processes, and data flows with security and governance in mind.
• Promote code quality, data security, scalability, and maintainability.
• Stay current with Databricks and related technologies to enable innovation.

Skills

Leadership

Communication

Problem solving

French-speaking

SQL

Spark

Databricks

Delta Lake

Microsoft Fabric

Power BI

CI/CD

Git

Hadoop

Azure Synapse

Data Governance

Cloud security

Tools

Azure Databricks

PySpark

Azure Data Lake

Azure Synapse

Azure Data Factory

Power BI

Delta Live Tables

Delta Lake

Hadoop

Git

CI/CD

Job description

• Lead the architecture, design, and implementation of advanced analytics solutions using Azure Databricks and Microsoft Fabric.
  
• Apply deep expertise in big data technologies, data engineering, cloud computing, Azure Databricks, and strong SQL skills to deliver scalable solutions.
  
• Work closely with business stakeholders and IT teams to understand requirements and deliver effective, business-aligned solutions.
  
• Oversee end-to-end implementation of data solutions, ensuring alignment with business requirements and industry best practices.
  
• Lead the development of data pipelines and ETL processes using Azure Databricks, PySpark, and other relevant tools.
  
• Integrate Azure Databricks with Azure services such as Azure Data Lake, Azure Synapse, Azure Data Factory, and on-premises systems.
  
• Provide expertise in Spark; Scala experience is an added advantage.
  
• Demonstrate strong Microsoft Fabric expertise, including pipeline development, notebook development, semantic modelling, real-time intelligence, and related scenarios.
  
• Provide technical leadership and mentorship to the data engineering team, fostering a culture of continuous learning and improvement.
  
• Ensure proper documentation of architecture, processes, and data flows while maintaining compliance with security and governance standards.
  
• Promote best practices for code quality, data security, scalability, and maintainability.
  
• Stay current with the latest developments in Databricks and associated technologies to support continuous innovation.
  
• Mandatory French-speaking capability.
  
• Strong experience with Azure Databricks, including cluster management, notebook development, and Delta Lake.
  
• Proficiency in big data technologies such as Hadoop and Spark, along with data processing frameworks such as PySpark.
  
• Experience with Power BI, SSRS, SSAS, and SKU migration from P-SKU to F-SKU.
  
• Experience with ETL/ELT processes, data warehousing, and data lake development.
  
• Strong SQL skills and familiarity with NoSQL databases.
  
• Experience with CI/CD pipelines and version control systems such as Git.
  
• Knowledge of cloud security best practices.
  

Requirements

Soft Skills

• Mandatory French-speaking capability.
  
• Excellent communication skills, with the ability to explain complex technical concepts to non-technical stakeholders.
  
• Strong problem-solving skills and a proactive approach to identifying and resolving issues.
  
• Leadership skills, with the ability to manage and mentor a team of data engineers.
  

Nice-to-Have Skills

• Power BI experience for dashboarding and reporting.
  
• Microsoft Fabric experience for analytics and integration tasks.
  
• Spark Streaming experience for processing real-time data streams.
  
• Familiarity with Azure Resource Manager templates for infrastructure as code practices.
  

Experience

• Demonstrated expertise of 12 years in developing data ingestion and transformation pipelines using Databricks/Synapse notebooks and Azure Data Factory.
  
• Solid understanding and hands-on experience with Delta tables, Delta Lake, and Azure Data Lake Storage Gen2.
  
• Experience using Auto Loader and Delta Live Tables for seamless data ingestion and transformation.
  
• Proficiency in building and optimizing query layers using Databricks SQL.
  
• Demonstrated experience integrating Databricks with Azure Synapse, ADLS Gen2, and Power BI for end-to-end analytics solutions.
  
• Prior experience developing, optimizing, and deploying Power BI reports.
  
• Familiarity with modern CI/CD practices, especially in the context of Databricks and cloud-native solutions.