Data Engineer

Quarry Consulting; Canada; On-site; CAD 90,000 - 130,000; Full time

Job summary

Quarry Consulting in Canada is seeking a Senior Data Engineer to design and operate enterprise data integrations, focusing on scalable pipelines and analytics-ready datasets. You will work with Microsoft Fabric, PySpark, Python, SQL, and Azure data services to deliver end-to-end ingestion from APIs, files, databases, and third-party platforms.

You will contribute to curated data layers, data modeling, governance, and security, while optimizing pipelines for scale and cost.

Qualifications

• 7+ years of experience in data engineering and enterprise data integration.
• Hands-on with Microsoft Fabric and related Azure data services.
• Strong experience with PySpark, SparkSQL, Python, and SQL/T-SQL.
• Experience building ingestion and transformation pipelines from APIs, files, databases, and third-party platforms.
• Experience with curated data layers, data modeling, and analytics-ready datasets.
• Experience tuning data pipelines for scale, resiliency, and cost optimization.
• Working knowledge of security, access controls, and data governance practices.
• Experience with Azure DevOps and Git-based deployment automation.

Skills

Data engineering

Enterprise data integration

Microsoft Fabric

PySpark

SparkSQL

Python

SQL / T-SQL

Data pipelines

Data modeling

Data governance

Security / access controls

Azure DevOps

Git-based deployment

Tools

Azure DevOps

Git

ADF

Synapse

Databricks

Azure Functions

Logic Apps

Purview

Job description

• 7+ years of experience in data engineering and enterprise data integration.
• Strong hands-on experience with Microsoft Fabric and related Azure data services.
• Strong experience with PySpark, SparkSQL, Python, and SQL/T-SQL.
• Experience building ingestion and transformation pipelines from APIs, files, databases, and third-party platforms.
• Experience with curated data layers, data modeling, and analytics-ready datasets.
• Experience tuning data pipelines for scale, resiliency, and cost optimization.
• Working knowledge of security, access controls, and data governance practices.
• Experience with Azure DevOps and Git-based deployment automation.

Preferred Skills

• Experience with learning, HR, or talent data domains.
• Familiarity with ADF, Synapse, Databricks, Azure Functions, or Logic Apps.
• Exposure to AI tools such as GitHub Copilot and Claude to accelerate engineering productivity and solution design.
• Experience with data governance tooling such as Purview.
• Exposure to AI/ML-ready data preparation and feature engineering practices.