Data Engineering Expert

Co-operators; Mississauga; Hybrid; CAD 100,000 - 130,000; Full time

Job summary

A leading Canadian financial services co-operative is seeking a Data Engineering Expert to design data products and cloud architecture. The role involves collaboration with multiple teams, implementation of automation and CI/CD pipelines, and utilizing Azure services. Candidates should have significant experience in data engineering and strong communication skills. The position promotes a flexible work environment with numerous benefits.

Benefits

Opportunities for training and career growth

Flexible work options and paid time off

Comprehensive benefits including health, dental, and retirement plans

Qualifications

• 8-10 years of experience in data engineering and building modern data platforms.
• Strong experience coding with Terraform, Python, and PySpark.
• Hands-on experience with Azure services and data management best practices.

Responsibilities

• Design and implement cloud architecture and automate provisioning.
• Build and maintain CI/CD pipelines for data pipelines.
• Collaborate with stakeholders to develop data products.

Skills

Data Engineering

Terraform

Python

PySpark

Azure cloud infrastructure

Tools

Azure PaaS services

Databricks

API Management

Job description

Company : CGL

Department : Information Technology

Employment Type : Regular Full-Time

Language : This role operates in English

Work Model : Hybrid

Additional Information : This / these role(s) is / are currently vacant

The Opportunity :

We are a leading Canadian financial services co-operative committed to being a catalyst for a sustainable and resilient society. Our team is essential to deliver on this strategy. We prioritize our people, providing a strong culture and development opportunities to enable our team to thrive and live our purpose. You will work with passionate people who care about you, our clients, and our communities.

Our Information Technology team aims to be a leader in applying technology to power business strategies. We focus on creating value and efficiencies for our clients, employees, and communities through innovative solutions. Our success is driven by a skilled, diverse team passionate about excellence, innovation, and agility.

The Data Engineering Expert plays a critical role in the data organization. Responsibilities include leading the design and build of data products and platforms that handle large datasets, ensuring resilience, security, and compliance with governance policies. The role involves upskilling staff, implementing new tools, and owning end-to-end data product lifecycle management. Deep expertise in Azure cloud infrastructure, automation, and a security-first mindset are essential.

The Data Engineering Expert collaborates with business stakeholders, reporting specialists, and analytics teams to develop products meeting multiple stakeholder needs. They partner with networking, security, governance teams, and vendors like Microsoft and Databricks to build and maintain the data platform. This role also contributes to the cloud catalog to empower the data and cloud communities within Co-operators.

How you will create impact :

1. Design and implement cloud architecture, including capacity planning, infrastructure setup, networking, and detailed architectural diagrams.
2. Automate provisioning and management of Azure resources using Infrastructure as Code (IaaC), preferably Terraform.
3. Build and maintain CI/CD pipelines with code quality, security scanning, and vulnerability testing for automated deployment of data pipelines.
4. Integrate security principles into development and deployment processes, utilizing tools for vulnerability scanning and compliance monitoring.
5. Lead the development of robust data pipeline templates aligned with medallion architecture, including automation, data quality, and monitoring mechanisms.
6. Implement automated alerts for failures or performance issues to enable proactive resolution.
7. Establish documentation systems for current implementations and ongoing maintenance.
8. Identify and implement engineering best practices and process improvements to enhance team efficiency.
9. Collaborate with business and technology stakeholders to prioritize data initiatives and communicate project goals and outcomes.
10. Coordinate security and platform updates, sharing best practices across data teams.

How you will succeed :

• Innovative mindset with a focus on operational efficiency and client needs.
• Strong critical thinking skills to evaluate and propose solutions.
• Excellent communication skills to convey messages clearly and explore diverse viewpoints.
• Ability to build trust and guide colleagues’ development.

To join our team :

• 8-10 years of experience in data engineering, building modern data platforms and products.
• 5+ years coding with Terraform, Python, and PySpark; at least 3+ years designing scalable solutions in Azure.
• Hands-on experience with Azure PaaS services like ADLS, Databricks, ADF, Synapse, Event Hub, API Management, Key Vault, Azure SQL, and Purview, including backup and disaster recovery strategies.
• Strong knowledge of Azure infrastructure, security, networking, data modeling, ETL, and data warehousing best practices.
• Excellent project management, communication, and presentation skills.
• Experience with Microsoft Fabric, Azure ML, Azure OpenAI, or Databricks is a plus.
• Experience in creating a 360-degree customer view is an asset.

What you need to know :

• Background check required for successful candidates.

What’s in it for you?

• Opportunities for training and career growth.
• Flexible work options and paid time off.
• Well-being programs, mental health support, and a supportive culture.
• Paid volunteer days and comprehensive benefits including retirement plans, health, dental, disability, life insurance, and employee assistance programs.