Data Engineer - Azure & Databricks Data Platform

Zurich Canada; Toronto; Hybrid; CAD 120,000 - 150,000; Full time

Job summary

Zurich Canada is seeking a Data Engineer to build, operate and support data pipelines and analytics-ready datasets across the organization. You will ingest, transform and curate high-quality data using Microsoft Azure and Databricks, working with data engineers, platform teams and stakeholders in a hybrid work model.

You will design curated datasets, perform data-quality checks, monitor production jobs and partner with analytics and AI teams to enable reporting and AI-enabled use cases while

Qualifications

• Hands-on Python for data processing and automation.
• SQL used for querying and transforming data.
• Exposure to Databricks or similar cloud data platforms.
• Familiarity with Azure services (storage/compute/identity).
• Understanding ETL/ELT, data modeling, schema evolution.
• Data quality, validation and monitoring practices.

Responsibilities

• Develop and maintain scalable data pipelines on Databricks on Azure.
• Build data transformations using Python and SQL per standards.
• Ingest data from enterprise apps, files, APIs and event sources.
• Design and curate datasets across Lakehouse layers (raw, refined, curated).
• Perform data-quality checks and anomaly detection to improve reliability.
• Monitor production jobs, troubleshoot failures and resolve issues.
• Collaborate with analytics, data science and AI teams to enable reporting and AI use cases.
• Follow data governance, privacy and security requirements.
• Contribute to technical documentation and runbooks.

Skills

Python data processing

SQL querying

Databricks

Azure cloud

ETL/ELT concepts

Data quality/monitoring

Version control

Data modeling

Problem solving

AI/ML awareness

Education

Bachelor's degree in CS/Engineering/IS or related

Tools

Delta Lake

CI/CD for data pipelines

Lakehouse architectures

Git

Job description

Zurich Canada is seeking a Data Engineer to build, operate and support data pipelines and analytics-ready datasets across the organization. You will ingest, transform and curate high-quality data using Microsoft Azure and Databricks, working with data engineers, platform teams and stakeholders in a hybrid work model.

You will design curated datasets, perform data-quality checks, monitor production jobs and partner with analytics and AI teams to enable reporting and AI-enabled use cases while