Application Developer - Azure Databricks

BrokerLink; Toronto; On-site; CAD 100,000 - 125,000; Full time

Job summary

A leading insurance brokerage in Toronto seeks a skilled BI / Data Engineer to build and maintain data pipelines, develop scalable solutions, and ensure data quality. The role requires 7+ years of experience in data engineering, proficiency in Python, PySpark, and SQL, and a background in Azure Databricks. Join a customer-focused team that values continuous learning and offers flexible work arrangements.

Qualifications

• 7+ years in BI / Data Engineering / Data Warehousing required.
• Microsoft certification preferred.
• Experience in Power BI is necessary.
• Ability to handle multiple priorities successfully.

Responsibilities

• Build and maintain data pipelines in Azure Databricks.
• Develop scalable and reliable solutions using Python and PySpark.
• Construct complex SQL queries for data profiling and manipulation.
• Optimize data processes for efficiency and reliability.
• Participate in all project phases, delivering accurate estimates.

Skills

Python

PySpark

SQL

Azure Databricks

Data modeling

Data warehousing

Power BI

Data security

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Microsoft Azure data services

Job description

Overview

Being a part of BrokerLink means you live our values: to act with integrity, be respectful of others, have a customer-driven mindset, strive for excellence and always treat others with generosity. These values drive our diversity and inclusion efforts to ensure a respectful and inclusive work environment is present. We want like-minded individuals who want to provide the highest level of customer service and carry themselves with utmost professionalism. We invest in you and believe success is our success and our purpose of “we’re here to help people” motivates us to keep the amazing talent we attract for a long time. We offer countless opportunities to grow in an environment that values our team members. We have over 200 offices across Canada and offer flexible work arrangements.

We are seeking a highly skilled BI / Data Engineer to join our Information Technology Department at one of our branch offices in Toronto, ON.

What the Role Entails

• Build and maintain data pipelines in Azure Databricks.
• Develop scalable and reliable solutions using Python and PySpark.
• Construct complex SQL queries for data profiling, efficient data manipulation and retrieval.
• Work with various teams to translate business needs into technical specifications.
• Optimize data processes for maximum efficiency and reliability.
• Ensure data quality and integrity.
• Develop and maintain data models, data flow diagrams, and data dictionaries.
• Participate in all project phases, delivering accurate estimates for analysis, coding, testing and documentation while maintaining effective communication about progress.
• Offer technical expertise to analyze requirements and devise practical, scalable, and maintainable solutions.
• Promptly identify and report any challenges affecting task completion, with revised timelines and remediation plans.
• Provide ongoing 3rd level support of applications to reduce the impact of defects and related incidents.
• Commit to continuous learning and improvement.
• Proactively evaluate system performance and quality, propose enhancements and implement updates for optimal functionality.
• Offer technical expertise in requirements analysis and solution design to ensure fit-for-purpose and scalable outcomes.

The Successful Candidate will have

• Bachelor’s or Master’s degree in Computer Science or related field.
• Microsoft certification preferred.
• Minimum 7 years in BI / Data Engineering / Data Warehousing.
• Proven experience with Azure Databricks, and other Azure data services.
• Must have expertise in Python, PySpark, and SQL.
• Knowledgeable in data modeling, data warehousing and ETL processes.
• Experience in Power BI.
• Skilled in data security.
• Strong customer focus and ability to handle multiple priorities successfully.
• Strong analytical and problem-solving abilities.
• Excellent verbal and written communication skills.
• Property and Casualty insurance background is considered an asset.
• Ability to pass a criminal background check and credit check.