Principal Data Engineer

Arcadia Search; Toronto; Hybrid; CAD 180,000 - 210,000; Full time

Job summary

A leading data-driven consultancy is seeking a Principal Data Engineer to lead the design and optimization of a modern data platform built on Azure and Databricks. The ideal candidate will have over 10 years of experience, focusing on scalable architectures and mentorship within high-performing teams in a hybrid work setting.

Qualifications

• 10+ years of experience in data engineering.
• Deep expertise with Azure, Databricks, and data pipelines.
• Experience leading teams and mentoring engineers.

Responsibilities

• Architect and implement scalable data platforms using Azure Data Lake and Databricks.
• Build and optimize PySpark workflows for batch and streaming data.
• Implement and enforce enterprise-grade security and data governance.

Skills

Azure cloud technologies

Databricks

PySpark

Delta Lake

Advanced SQL performance tuning

Cloud security

Agile methodologies

Infrastructure-as-Code

Education

Azure Data Engineering Certification

Databricks Certification

Terraform Certification

Tools

Terraform

Power BI

Job description

Get AI-powered advice on this job and more exclusive features.

Hybrid in downtown Toronto - 1-2 days per week

Type: Full-time | Permanent

Salary: - $180-210k base + Bonus

A leading data-driven consultancy is hiring a Principal Data Engineer to lead the design, development, and optimization of a modern data platform built on Azure and Databricks. This role is ideal for someone who thrives on architecture-level thinking, hands-on implementation, and mentoring high-performing teams - all while working on enterprise-scale data environments.

What You’ll Do

• Architect and implement scalable data platforms using Azure Data Lake and Databricks
• Design and maintain incremental ingestion pipelines leveraging ADF, CDC, and Databricks Auto Loader
• Build and optimize PySpark workflows for both batch and streaming data
• Manage and refine Delta Lake architecture across Bronze, Silver, and Gold layers
• Drive performance tuning and cost optimization of Databricks and Azure SQL workloads
• Implement and enforce enterprise-grade security, access control, and data governance
• Collaborate with BI, data science, and business teams to deliver end-to-end solutions
• Mentor engineers and define best practices across the data team

What We’re Looking For

• 10+ years of experience in data engineering, with a focus on Azure cloud technologies
• Deep expertise with Databricks, PySpark, and Delta Lake
• Proven ability to architect and maintain pipelines using ADF, Azure SQL, and CDC methods
• Strong grasp of both batch and streaming architectures
• Advanced SQL performance tuning skills
• Familiarity with cloud security, compliance, and governance frameworks
• Experience leading teams in Agile, delivery-oriented environments
• Experience with Terraform or Infrastructure-as-Code
• Certifications in Azure Data Engineering, Databricks, or Terraform
• Familiarity with Power BI and its integration with Databricks/ADLS
• Competitive compensation ($180K–$210K CAD base + bonus)
• Principal-level ownership of modern Azure-based data platforms
• Work on mission-critical systems with a team of elite data professionals
• Opportunity to shape architecture and delivery on high-impact, enterprise-scale projects
• Remote flexibility with a Toronto-based hub and strong engineering culture

Seniority level

• Seniority level

  Director

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Arcadia Search by 2x

Get notified about new Data Engineer jobs in Toronto, Ontario, Canada.

Toronto, Ontario, Canada CA$105,000.00-CA$120,000.00 1 month ago

Data Engineer, Fall 2025 - Toronto (Co-op/Internship) - 4 Months

Software Engineer I, Entry Level (Fall 2024-Spring 2025) - Toronto

Toronto, Ontario, Canada CA$90,000.00-CA$100,000.00 2 weeks ago

Toronto, Ontario, Canada CA$115,900.00-CA$160,400.00 2 weeks ago

Software Engineer, Backend (All Levels / All Teams)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.