Databricks Engineer - Azure Data Pipelines & Lakehouse

Compunnel, Inc.; Mississauga; On-site; CAD 120,000 - 150,000; Full time

Job summary

A leading technology company in Canada seeks a Databricks Engineer. The role involves designing and optimizing large-scale data pipelines using Databricks and Azure, requiring over 10 years of experience in data engineering and strong expertise in Spark, PySpark, and Databricks. You'll collaborate with teams to provide scalable data solutions and ensure compliance with data governance. This position provides an opportunity to work on impactful projects in the financial sector.

Qualifications

• 10+ years of experience in data engineering.
• Experience in financial services, banking, or capital markets.
• Strong expertise in Databricks and Azure cloud services.

Responsibilities

• Design and develop large-scale data pipelines.
• Optimize Databricks workloads for performance.
• Implement data governance and compliance frameworks.

Skills

Databricks

Spark/PySpark

Azure cloud services

Data governance

Python programming

Tools

Databricks Asset Bundles

GitLab

Job description

A leading technology company in Canada seeks a Databricks Engineer. The role involves designing and optimizing large-scale data pipelines using Databricks and Azure, requiring over 10 years of experience in data engineering and strong expertise in Spark, PySpark, and Databricks. You'll collaborate with teams to provide scalable data solutions and ensure compliance with data governance. This position provides an opportunity to work on impactful projects in the financial sector.