Senior Data Engineer - Microsoft Fabric

Accellor; Canada; On-site; CAD 100,000 - 130,000; Full time

Job summary

A digital transformation partner is seeking a Senior Data Engineer in Canada. The candidate will design and optimize data solutions using Microsoft Fabric, requiring expertise in data engineering and a strong background in Python and REST API development. The ideal candidate has over five years of experience and is skilled in data modeling and performance tuning. This role offers the opportunity to work in a supportive and collaborative environment focused on innovation and growth.

Qualifications

• 5+ years of data engineering experience.
• Hands-on experience with Microsoft Fabric notebooks and pipelines.
• Strong understanding of data governance and security best practices.

Responsibilities

• Design and implement scalable data pipelines within Microsoft Fabric.
• Collaborate with stakeholders to translate business requirements into technical solutions.
• Optimize and tune Delta, Spark, and SQL workloads.

Skills

Microsoft Fabric expertise

Advanced Python proficiency

Data modeling skills

REST API development

Pandas and Polars for data manipulation

Experience with Agile/Scrum methodologies

Tools

Visual Studio Code

Azure DevOps

Delta Lake and Iceberg table formats

Job description

Get AI-powered advice on this job and more exclusive features.

At Accellor, we are a trusted digital transformation partner that uses best-of-breed Cloud technology to deliver superior customer engagement and business effectiveness for clients. We've created an atmosphere that encourages curiosity, constant learning, and persistence. We encourage our employees to grow and explore their interests. We cultivate an environment of collaboration, autonomy, and delegation – we know our people have a strong work ethic and a sense of pride and ownership over their work. They are passionate, eager, and motivated – focused on building the perfect solution but never losing sight of the bigger picture.

Role: Senior Data Engineer - Microsoft Fabric

Position Overview

We are seeking an experienced Senior Data Engineer for a contract position to design, develop, and optimize data solutions using Microsoft Fabric. This role requires deep technical expertise in modern data engineering practices and Microsoft's unified analytics platform. Similar experience with Data Bricks would be considered.

Key Responsibilities

• Design and implement scalable data pipelines and ETL/ELT processes within Microsoft Fabric from a code-first approach
• Develop and maintain notebooks, data pipelines, workspace and other Fabric item configurations
• Build and optimize data architectures using delta tables, lakehouse, and data warehouse patterns
• Implement data modelling solutions including star schema, snowflake schema, and slowly changing dimensions (SCDs)
• Performance tune Delta, Spark, and SQL workloads through partitioning, optimization, liquid clustering, and other advanced techniques
• Develop and deploy Fabric solutions using CI/CD practices via Azure DevOps
• Integrate and orchestrate data workflows using Fabric Data Agents and REST APIs
• Collaborate with development team and stakeholders to translate business requirements into technical solutions

Requirements

Microsoft Fabric Expertise

• Hands-on experience with Fabric notebooks, pipelines, and workspace configuration
• Fabric Data Agent implementation and orchestration
• Fabric CLI and CI/CD deployment practices

Programming & Development

• Python (advanced proficiency)
• PySpark for distributed data processing
• Pandas and Polars for data manipulation
• Experience with Python libraries for data engineering workflows
• REST API development and integration

Data Platform & Storage

• Delta Lake and Iceberg table formats
• Delta table optimization techniques (partitioning, Z-ordering, liquid clustering)
• Spark performance tuning and optimization
• SQL query optimization and performance tuning

Development Environment

• Visual Studio Code
• Azure DevOps for CI/CD and deployment pipelines
• Experience with both code-first and low-code development approaches

Data Modeling

• Data warehouse dimensional modeling (star schema, snowflake schema)
• Slowly Changing Dimensions (SCD Type 1, 2, 3)
• Modern lakehouse architecture patterns
• Metadata driven approaches

Preferred Qualifications

• 5+ years of data engineering experience
• Previous experience with large-scale data platforms and enterprise analytics solutions
• Strong understanding of data governance and security best practices
• Experience with Agile/Scrum methodologies
• Excellent problem-solving and communication skills

Referrals increase your chances of interviewing at Accellor by 2x

Get notified about new Senior Data Engineer jobs in Canada.