Senior Specialist, Data Engineering

CMHC; Montreal; On-site; CAD 80,000 - 100,000; Full time

Job summary

A leading housing organization in Canada is seeking a Senior Specialist, Data Engineering to join their IT team. The role involves designing and programming data pipelines using Azure technologies, ensuring high-quality data for improving housing affordability. Candidates should have a degree in a related field and extensive experience in data engineering, particularly with Azure tools. Competitive benefits and a commitment to diversity are offered.

Benefits

Annual paid vacation

Annual performance incentive

Defined benefit pension plan

Comprehensive group insurance plan

Support for personal and professional growth

Qualifications

• A minimum of seven years of IT experience in data implementations.
• Extensive experience working with cloud technologies, preferably Azure.
• Experience with Continuous Integration and Continuous Delivery (CI/CD) is a plus.

Responsibilities

• Design, program, and document data pipelines using Azure technologies.
• Provide support for existing data pipelines, responding to incidents.
• Collaborate with other IT professionals to deliver data processing pipelines.

Skills

Programming in Python using PySpark

SQL

Data engineering best practices

Collaboration skills

Communication of complex data concepts

Education

Undergraduate or bachelor’s degree in computer science or related field

Master’s degree in a related field

Tools

Azure Data Factory

Azure Databricks

SQL

DB2

Job description

About CMHC

About CMHC

The work you do and the work we do together matters. We come to work every day with a common purpose: to contribute to a well-functioning housing system.

At CMHC, we hold ourselves accountable for our results and support our colleagues in their achievements. We thrive on collaboration, connecting across CMHC and involving the right people to get our work done. Our leadership style is guided by trust, where our leaders favour an adaptive approach based on the needs of their teams.

Join us and be part of a team that's committed to making a real difference and be part of something meaningful.

What’s in it for you

We’ve got the purpose, the people and the perks you need for a fulfilling career. Here’s the comprehensive and generous benefits you get when you’re a permanent employee:

• Annual Paid vacation.
• Annual individual performance incentive.
• Defined benefit pension plan.
• Comprehensive group insurance plan to support your well-being from day one.
• Support towards your personal and professional growth with training, mentorship and more.
• An inclusive workplace culture and environment.

About the role

Join the Information Technology team, in the Senior Specialist, Data Engineering position. In this role, you will be responsible for the delivery and support of well performing data pipelines. High quality data is the foundation of CMHC’s work to improve housing affordability for Canadians. As a Data Engineer you will join an existing team to do hands on work programming and configuring of pipelines and notebooks in Azure Databricks, Azure Data Factory, Azure SQL, and related tools. You will also do some work connecting to legacy data sources such as SQL and DB2. You will contribute your expertise to maintain a well functioning and performing technical environment. You will follow standard patterns and architecture while contributing to their evolution. You will perform testing to build well performing pipelines and respond to incidents if there is a failure. You will use root cause analysis to identify permanent fixes to issues.

What you’ll do

• Design, program, test, and document data pipelines/ETLs using Azure technologies.
• Provide second level support for existing pipelines and data processes, responding to incidents and implementing fixes.
• Provide thought leadership and expertise during the design of new data processing initiatives.
• Employ data management best-practices to move large volumes of data from various operational systems to data models for analytics consumption.
• Understand stakeholder business requirements, enterprise architecture, policies, and standards to build data pipelines for long-term compatibility, scalability, and maintainability.
• Work closely with other employees in CMHC’s business lines to deliver data processing pipelines that meet their needs.
• Collaborate with other IT professionals including data and analytics architects, data stewards, data scientists, enterprise architects when building solutions.
• Provide peer support as well as mentoring to others developing data processes and provide oversight on the designs of vendor delivered data processes.

What you should have

• An undergraduate degree or a bachelor’s degree in computer science, software engineering or in a related field.
• A minimum of seven (7) years of IT experience in data implementations encompassing the items below. An equivalent combination of related education and work experience may be considered.
• A strong ability to program in Python using PySpark and SQL as demonstrated by your delivery of multiple data processing projects in production.
• Experience working in a secure, structured, and controlled IT environment with separation of duties, adherence to policy and architecture.
• Extensive experience with processing large datasets from multiple sources using data engineering as well as ingesting data into data lakes and data warehouses.
• Extensive experience working with cloud technologies (Azure preferred). An Azure certification is considered an asset.
• Ability to communicate complex data processing concepts and designs to various audiences in IT and other part of CMHC’s business lines while listening to others.
• Strong behavioural competencies to work in a collaborative environment and develop solutions and fixes for high client and team satisfaction.

It would be great if you also had

• A master’s degree in a related field.
• Experience with Continuous Integration and Continuous Delivery (CI/CD).

Posting closing date

Note, the competition may remain active until filled.

Our commitment to diversity, equity, and inclusion

We’re committed to employment equity and encourage women, Indigenous Peoples, persons with disabilities, veterans and persons of all races, ethnicities, religions, abilities, sexual orientations, and gender identities and expressions to apply. We also welcome applications from non-Canadians who are eligible to work in Canada.

CMHC is an inclusive workplace where diversity of thought – and of people – are recognized, valued, and considered essential to achieving our mission.

What happens after you apply

We know that applying for a new job can be both exciting and daunting, and we appreciate your effort.

Learn more about our hiring process

If you applied before and you were not successful don’t worry – we’re always posting new positions, so don’t hesitate to give it another shot. We’re excited to see what you bring to the table this time around!