Sr Databricks Engineer (Banking)

BeachHead Inc.; Toronto; On-site; CAD 96,000 - 103,000; Full time

Job summary

BeachHead Inc. seeks a Sr Databricks Engineer to modernize data platforms on Azure Databricks for a major financial client in Toronto. You will transform legacy systems into scalable data solutions, support enterprise data workflows, and ensure secure, compliant processing.

The role emphasizes Python development, data modeling, and best practices in ETL, with a focus on building reliable, high-volume pipelines and collaborating with cross-functional teams.

Qualifications

• 5+ years of experience with Azure Databricks and data pipelines.
• Strong Python development and Spark expertise.
• Solid knowledge of data modeling and ETL best practices.

Responsibilities

• Develop and maintain end-to-end data pipelines on Azure Databricks.
• Implement Bronze-Silver-Gold data architecture and optimization.
• Automate ingestion using Azure Data Factory and monitor pipelines.
• Ensure data quality, security, and regulatory compliance.
• Document designs and workflows for ongoing support.

Skills

Python programming

Data modeling

Data warehousing

ETL best practices

Cloud concepts

Data security

Tools

Azure Databricks

Azure Data Factory

Job description

Looking for a skilled Databricks Engineer to support a major data modernization project?

Working with one of our top financial clients, this role calls for a Sr Databricks Engineer (Banking). The successful candidate will play a key role in transforming legacy platforms into modern, scalable data solutions on Azure Databricks, supporting enterprise-scale data workflows and modernization initiatives.
Pay rate range (CAD): $70.00/hr – $75.00/hr

Responsibilities

• Develop and maintain end-to-end data pipelines on Azure Databricks using Python and Spark.
• Implement and optimize data transformations aligned with the Medallion Architecture (Bronze, Silver, Gold).
• Automate workflows incorporating Azure Data Factory for data ingestion and processing.
• Monitor pipeline performance, troubleshoot issues, and optimize data workflows.
• Collaborate with cross-functional teams to support data modernization efforts and ensure seamless data delivery.
• Support migration from legacy systems to scalable cloud data architecture.
• Ensure data quality, security, and compliance standards are maintained throughout all phases of data processing.
• Document technical designs, processes, and workflows for ongoing support and enhancement.

Desired Skill-Set

• Minimum of 5+ years of experience with Azure Databricks.
• Proficiency in Python programming.
• Strong knowledge of data modeling, data warehousing, and ETL best practices.
• Experience with automating data workflows using Azure Data Factory.
• Proven ability to monitor, troubleshoot, and optimize high-volume data pipelines.
• Hands-on experience with enterprise-scale data environments.
• Knowledge of cloud computing concepts and data security standards.

Nice to Have

• Familiarity with SQL and data visualization tools.
• Experience working in financial services or regulated environments.
• Knowledge of other cloud platforms such as AWS or GCP.
• Exposure to DevOps practices for data pipeline deployment.
• Certification in Azure Data Engineering or similar.

BeachHead is an equal opportunity agency and employer. We advocate for our candidates and welcome applicants regardless of race, color, religion, national origin, sex, age, or physical or mental disability.

Privacy Policy