Hybrid Data Engineer – Azure Databricks & Lakehouse

CIBC US; Toronto; Hybrid; CAD 90,000 - 130,000; Full time

Job summary

CIBC is seeking a Consultant, Application Developer (Data Engineer) in Toronto to drive enterprise data pipelines on Azure Databricks and govern data products. You will design, implement, and optimize batch and streaming pipelines while enforcing standards for quality, security, and monitoring.

You’ll partner with architecture, governance, and business teams to translate requirements into scalable data solutions and deliver value in a hybrid on-site/remote setup.

Qualifications

• 5-8 years progressive data engineering experience with technical leadership.
• Hands-on Databricks and Spark with production-grade pipelines.
• Governed lakehouse solutions using Delta Lake and Unity Catalog.
• Experience with CI/CD for Databricks workloads across environments.
• Strong knowledge of Azure data services and Agile delivery, familiar with Informatica modernization.

Responsibilities

• Lead end-to-end design and delivery of enterprise data pipelines on Azure Databricks.
• Define engineering standards for code quality, testing, deployment, security, and monitoring.
• Architect, test, deploy, and support batch and streaming pipelines; automate testing and CI/CD.
• Build relationships with stakeholders, data owners, governance teams, and vendors.
• Ensure applications and data platforms operate securely and efficiently.

Skills

Analytical Thinking

Application Development

Applications Programming

Emerging Technologies

IT Strategic Planning

Mentoring Staff

Project Management Technology

Work Collaboratively

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Databricks

Spark

Delta Lake

Unity Catalog

Auto Loader

Structured Streaming

Git CI/CD

Job description

CIBC is seeking a Consultant, Application Developer (Data Engineer) in Toronto to drive enterprise data pipelines on Azure Databricks and govern data products. You will design, implement, and optimize batch and streaming pipelines while enforcing standards for quality, security, and monitoring.

You’ll partner with architecture, governance, and business teams to translate requirements into scalable data solutions and deliver value in a hybrid on-site/remote setup.