Data Engineering Expert

Co-operators; Guelph; Hybrid; CAD 90,000 - 120,000; Full time

Job summary

A leading financial services co-operative in Ontario is seeking a Data Engineering Expert to lead data product design and implementation. The role requires extensive experience with Azure and a strong background in coding using Terraform and Python. You will contribute to building resilient data solutions and ensure compliance, while also focusing on stakeholder collaboration and alignment on data initiatives. The organization offers a hybrid work model along with competitive benefits.

Benefits

Career growth through training and development

Flexible work options

Health and wellness programs

Paid volunteer days

Competitive salary and comprehensive benefits

Qualifications

• 8-10 years in data engineering, building modern data platforms and products.
• 5+ years coding with Terraform, Python, PySpark.
• 3+ years designing scalable solutions in Azure.

Responsibilities

• Designing and implementing cloud architecture.
• Automating resource provisioning with Infrastructure as Code.
• Building and maintaining CI/CD pipelines for data engineering.

Skills

Data Engineering

Azure Cloud Infrastructure

Terraform

Python

PySpark

CI/CD Pipelines

Tools

Azure ADLS

Databricks

Azure ADF

Azure Synapse

API Management

Job description

Company : CGL

Department : Information Technology

Employment Type : Regular Full-Time

Language : This role operates in English

Work Model : Hybrid

Additional Information: This role is currently vacant.

The Opportunity :

We are a leading Canadian financial services co-operative committed to sustainability and resilience. Our team is essential to delivering this strategy. We prioritize our people to foster a strong culture and development opportunities, enabling our team to thrive and live our purpose. You will work with passionate colleagues who care about you, our clients, and communities.

Our Information Technology team aims to lead in applying technology to power business strategies. We connect concepts with solutions to create value and efficiencies for clients, employees, and communities. Our success is driven by a skilled, diverse team passionate about excellence, innovation, and agility.

The Data Engineering Expert is a critical role responsible for leading the design and build of data products and platforms, ensuring resilience, security, and compliance, while upskilling staff and leading new tool implementation. Deep understanding of Azure cloud infrastructure, automation, and security is essential.

This role partners with business, analytics, security, governance, and vendors like Microsoft and Databricks to build data platforms, contributing to the cloud catalog and empowering the data community.

How you will create impact :

• Designing and implementing cloud architecture, including capacity planning, infrastructure setup, and detailed diagrams.
• Automating resource provisioning with Infrastructure as Code (Terraform preferred).
• Building and maintaining CI/CD pipelines for data engineering pipelines with security and quality checks.
• Integrating security throughout development and deployment, using vulnerability scanning and compliance tools.
• Leading the creation of data pipeline templates based on medallion architecture, including automation and monitoring.
• Defining automated alerts for failures or performance issues to enable proactive resolution.
• Establishing documentation systems for existing infrastructure and ongoing maintenance.
• Implementing engineering best practices and process improvements.
• Partnering with stakeholders to prioritize data initiatives, communicate progress, and ensure alignment.
• Leading security and platform updates, sharing best practices across the data engineering community.

How you will succeed :

• Innovative mindset focused on operational efficiency and client needs.
• Critical thinking to evaluate and propose solutions.
• Strong communication skills for clear messaging and diverse viewpoints.
• Ability to build trust and guide colleagues.

To join our team :

• 8-10 years in data engineering, building modern data platforms and products.
• 5+ years coding with Terraform, Python, PySpark; 3+ years designing scalable solutions in Azure.
• Hands-on experience with Azure PaaS services like ADLS, Databricks, ADF, Synapse, Event Hub, API Management, Key Vault, SQL, Purview.
• Understanding of Azure infrastructure, security, networking, data modeling, ETL, and warehousing.
• Excellent project management and communication skills.
• Experience with Microsoft Fabric, Azure ML, Azure OpenAI, Databricks is a plus.
• Experience creating a 360 customer view is an asset.

What you need to know :

• Background check required for successful candidates.

What’s in it for you?

• Career growth through training and development.
• Flexible work options and paid time off.
• Health and wellness programs, supportive culture.
• Paid volunteer days.
• Competitive salary, incentives, and comprehensive benefits including retirement plans, health, dental, disability, life insurance, mental health support, and employee assistance programs.