DATA ENGINEERING SPECIALIST

BDC; Montreal; Hybrid; CAD 70,000 - 110,000; Full time

Job summary

Join a forward-thinking organization that champions innovation and diversity. As a Data Engineer, you'll be integral to the data platform team, working on cutting-edge projects that transform data into actionable insights. Your expertise in Azure technologies and programming will help shape the future of data management. With a hybrid work model and a commitment to employee well-being, this role offers a unique opportunity to contribute to the success of Canadian entrepreneurs while thriving in a supportive and inclusive environment.

Benefits

Flexible benefits

Employee Savings and Investment Plan

$750 wellness spending account

Paid vacation and personal days

Hybrid work model

Opportunities for training and development

Qualifications

• 3+ years of experience as a Data Engineer with a focus on data ingestion and transformation.
• Experience with Azure technologies and strong communication skills are essential.

Responsibilities

• Design and develop ELT pipelines for data ingestion and transformation.
• Collaborate with data analysts and governance teams to ensure data quality.

Skills

Python

Databricks

SQL

Data Governance

Agile Processes

Communication

Education

Bachelor's degree in IT, Computer Science, Statistics, or Mathematics

Tools

Azure Data Factory

Azure Databricks

Azure DevOps

Apache Spark

Power BI

Job description

We are banking at another level.

Choosing BDC as your employer means working in a healthy, inclusive, and skilled workplace that puts forward the best conditions to bring together unique teams where employees are empowered to act. It also means being at the centre of ambitious economic and financial projects to see further and to do things differently, to fuel the success of Canadian entrepreneurs.

Choosing BDC as your employer also means:

• Flexible and competitive benefits, including an Employee Savings and Investment Plan where BDC matches part of your voluntary contributions, a Defined Benefit Pension Plan, a $750 wellness and health care spending account, to name a few

• In addition to paid vacation each year, five personal days, sick days as necessary, and our offices are closed from December 25 to January 1

• A hybrid work model that truly balances work and personal life

• Opportunities for learning, training and development, and much more...

POSITION OVERVIEW

As a Data Engineer, you will be working at the data platform team and contribute to enterprise-wide best practices, processes, and platforms for BDC's strategy.

The bulk of the work will be in data exploration, data ingestion, data transformation, data preparation, designing, building, and developing pipelines consolidating streaming and batch data sources into the Enterprise Data Lake.

You will work on the frameworks and libraries that data platform team creates and maintains to progress from data to value.

CHALLENGES TO BE MET

• Participate with data analysts to map data fields to answer business needs
• Ingest, curate, wrangle, and prepare data for use in AAAI models and other systems
• Collaborate with Data Governance Office and participate in data governance practices (data lifecycle management, data quality management, data cataloging, and metadata management)
• Support databricks business users community
• Design, build and develop ELT pipelines consolidating streaming and batch data sources into the Data Lake zones
• Design, code, unit test, and integrate new features and functionality to BDC’s data engineering libraries
• Develop clean and maintainable code with continuous integration / continuous deployment (CI/CD) best practices to prevent integration problems and ensure the code is releasable at any point in time
• Create and maintain datasets on Azure Data Lake (ADLS) utilizing Azure Data Factory (ADF) and Azure Databricks
• Develop data ingestion, transformation, and preparation with Scala/Python and Apache Spark
• Contribute to designing and building the infrastructure required for optimal ingestion, transformation, and loading of data from a wide variety of data sources using Azure big data technologies (ADLS, ADF, Databricks, and Azure Functions) and Power BI technologies
• Participate in scrum meetings and update stories on Azure DevOps
• Participate in the estimation of the stories based on the defined Acceptance Criteria, Definition of Ready, and Definition of Done

WHAT WE ARE LOOKING FOR

• A bachelor’s degree in IT, Computer Science, Statistics, Mathematics, or related fields
• 3+ years of industry experience as a Data Engineer
• 3+ years of experience with Databricks platform
• 2+ years of experience with Python programming language
• Experience with Azure data factory
• Experience with the Azure DevOps pipelines
• Experience with SQL language and other relational database management systems
• Experience with Agile processes
• Strong interpersonal, strong communication and documentation
• Bilingual (French & English)

Proudly one of Canada’s Top 100 Employers and one of Canada’s Best Diversity Employers, we are committed to fostering a diverse, equitable, inclusive and accessible environment where all employees can thrive and feel empowered to bring their whole selves to work. If you require an accommodation to complete your application, please do not hesitate to contact us at [e-mail] .

While we appreciate all applications, we advise that only the candidates selected to participate in the recruitment process will be contacted.