Senior Specialist, Data Engineering

Canada Mortgage and Housing Corporation; Ottawa; On-site; CAD 101,000 - 128,000; Full time

Job summary

A national housing organization in Ottawa is seeking a Senior Specialist, Data Engineering. You will design and support data pipelines utilizing Azure technologies. The ideal candidate has at least seven years of IT experience, strong programming skills in Python and SQL, and experience with cloud technologies. A commitment to collaboration and diversity is essential. This role offers a competitive salary and comprehensive benefits.

Benefits

Annual Paid vacation

Annual individual performance incentive

Comprehensive group insurance plan

Support towards personal and professional growth

Inclusive workplace culture

Qualifications

• Minimum of seven years of IT experience in data implementations.
• Strong ability to program in Python using PySpark and SQL.
• Extensive experience with processing large datasets.

Responsibilities

• Design, program, test, and document data pipelines using Azure technologies.
• Provide second level support for existing pipelines.
• Collaborate with IT professionals to build solutions.

Skills

Python

SQL

Data Engineering

Azure

Collaboration

Education

Undergraduate or Bachelor's degree in computer science or related field

Tools

Azure Databricks

Azure Data Factory

DB2

Job description

Press Tab to Move to Skip to Content Link

Select how often (in days) to receive an alert:

Language Skill Levels (Read/Write/Speak):BBB

Security Requirement: Secret

Salary:Our salaries generally range from $101639.3to $127049.13and are based on qualifications and experience.

About CMHC

The work you do and the work we do together matters. We come to work every day with a common purpose: to contribute to a well-functioning housing system.

At CMHC, we hold ourselves accountable for our results and support our colleagues in their achievements. We thrive on collaboration, connecting across CMHC and involving the right people to get our work done. Our leadership style is guided by trust, where our leaders favour an adaptive approach based on the needs of their teams.

Join us and be part of a team that's committed to making a real difference and be part of something meaningful.

What’s in it for you

We’ve got the purpose, the people and the perks you need for a fulfilling career. Here’s the comprehensive and generous benefits you get when you’re a permanent employee:

• Annual Paid vacation.
• Annual individual performance incentive.
• Comprehensive group insurance plan to support your well-being from day one.
• Support towards your personal and professional growth with training, mentorship and more.
• An inclusive workplace culture and environment.

About the role
Join the Information Technology team, in the Senior Specialist, Data Engineering position. In this role, you will be responsible for the delivery and support of well performing data pipelines. High quality data is the foundation of CMHC’s work to improve housing affordability for Canadians. As a Data Engineer you will join an existing team to do hands on work programming and configuring of pipelines and notebooks in Azure Databricks, Azure Data Factory, Azure SQL, and related tools. You will also do some work connecting to legacy data sources such as SQL and DB2. You will contribute your expertise to maintain a well functioning and performing technical environment. You will follow standard patterns and architecture while contributing to their evolution. You will perform testing to build well performing pipelines and respond to incidents if there is a failure. You will use root cause analysis to identify permanent fixes to issues.

What you’ll do:

• Design, program, test, and document data pipelines/ETLs using Azure technologies.
• Provide second level support for existing pipelines and data processes, responding to incidents and implementing fixes.
• Provide thought leadership and expertise during the design of new data processing initiatives.
• Employ data management best-practices to move large volumes of data from various operational systems to data models for analytics consumption.
• Understand stakeholder business requirements, enterprise architecture, policies, and standards to build data pipelines for long-term compatibility, scalability, and maintainability.
• Work closely with other employees in CMHC’s business lines to deliver data processing pipelines that meet their needs.
• Collaborate with other IT professionals including data and analytics architects, data stewards, data scientists, enterprise architects when building solutions.
• Provide peer support as well as mentoring to others developing data processes and provide oversight on the designs of vendor delivered data processes.

What you should have:

• An undergraduate degree or a bachelor’s degree in computer science, software engineering or in a related field.
• A minimum of seven (7) years of IT experience in data implementations encompassing the items below. An equivalent combination of related education and work experience may be considered.
• A strong ability to program in Python using PySpark and SQL as demonstrated by your delivery of multiple data processing projects in production.
• Experience working in a secure, structured, and controlled IT environment with separation of duties, adherence to policy and architecture.
• Extensive experience with processing large datasets from multiple sources using data engineering as well as ingesting data into data lakes and data warehouses.
• Extensive experience working with cloud technologies (Azure preferred). An Azure certification is considered an asset.
• Ability to communicate complex data processing concepts and designs to various audiences in IT and other part of CMHC’s business lines while listening to others.
• Strong behavioural competencies to work in a collaborative environment and develop solutions and fixes for high client and team satisfaction.

It would be great if you also had:

• A master’s degree in a related field.
• Experience with Continuous Integration and Continuous Delivery (CI/CD).

Posting closing date: Note, the competition may remain active until filled.

Our commitment to diversity, equity, and inclusion

We’re committed to employment equity and encourage women, Indigenous Peoples, persons with disabilities, veterans and persons of all races, ethnicities, religions, abilities, sexual orientations, and gender identities and expressions to apply. We also welcome applications from non-Canadians who are eligible to work in Canada.

CMHC is an inclusive workplace where diversity of thought – and of people – are recognized, valued, and considered essential to achieving our mission.

We know that applying for a new job can be both exciting and daunting, and we appreciate your effort. Learn more about our hiring process . If you are selected for an interview or testing, please advise us if you require an accommodation.

If you applied before and you were not successful don’t worry – we're always posting new positions, so don’t hesitate to give it another shot. We’re excited to see what you bring to the table this time around!