Lead Data Engineering Specialist

Co-operators; Guelph; Hybrid; CAD 100,000 - 130,000; Full time

Job summary

A leading Canadian financial services co-operative seeks a Lead Data Engineering Specialist to drive the design and optimization of data products. This role involves overseeing complex data pipelines, mentoring juniors, and ensuring compliance with architectural requirements. Candidates should have extensive experience in data engineering, cloud-based solutions, and strong project management skills.

Benefits

Training and development opportunities

Flexible work options

Paid volunteer days

Comprehensive total rewards package

Qualifications

• 8+ years of progressive experience in data engineering.
• 5+ years of experience with distributed computing and infrastructure as code.
• Deep understanding of data modeling and ETL processes.

Responsibilities

• Lead the development of data solutions ensuring quality and integration.
• Create and maintain logical and physical data models.
• Monitor infrastructure for performance and reliability.

Skills

Data modeling

ETL processes

Cloud security

Distributed computing

Project management

Education

Bachelor's degree in Computer Science or related field

Tools

Terraform

SQL

pySpark

Azure Data Lake Storage

Azure Databricks

Job description

Join to apply for the Lead Data Engineering Specialist role at Co-operators

1 day ago Be among the first 25 applicants

Join to apply for the Lead Data Engineering Specialist role at Co-operators

Company: CGIC

Department: Information Technology

Employment Type: Regular Full-Time

Work Model: Hybrid

Language: This role operates in English

Additional Information: This/these role(s) is/are currently vacant

The Opportunity

We are a leading Canadian financial services co-operative committed to being a catalyst for a sustainable and resilient society and our team is essential to deliver on this strategy. That’s why we prioritize our people, to ensure we provide a strong culture and development opportunities which enables our team to thrive and to live our purpose. The best part is that you will work with people that care passionately about you, our clients, and our communities.

The Data engineering lead drives the technical detail design, oversees the development and optimization of data products, ensuring the reliability and performance of ETL processes. This role involves the design and management of complex data pipelines, to take responsibility for the implementation of solutions that comply with architectural requirements, and to collaborate with key partners to meet business objectives. The lead also mentors juniors, sharing expertise to foster their growth.

How You Will Create Impact

• Lead the development of data solutions, ensuring proper data quality and its monitoring, and proper integration aligned with the medallion architecture.
• Create and maintain logical and physical data models and architectural diagrams.
• Use data engineering tools for data querying (ex: SQL), data handling (ex: pySpark, stored procedures), data storage (ex: ADLS).
• Lead the design of the semantic layer.
• Proactively apply performance optimizations and monitoring of data solutions, such as alerts.
• Lead and enforce proper documentation, to ensure ongoing maintenance and updates.
• Use DevOps platforms (ex: GitHub) and manage infrastructure deployments through code (ex: Terraform).
• Use and maintain continuous integration and deployment (CI/CD) pipelines, ensuring proper deployment of data solutions.
• Promote and comply with security requirements on the platforms and environments used by our data solutions.
• Monitor the use of infrastructure for performance, reliability and cost.
• Lead and enforce proper documentation, to ensure ongoing maintenance and updates.
• Identify and implement engineering best practices and process improvements to enhance the efficiency and effectiveness of our data solutions.
  
  
  

How You Will Succeed

• You have an innovative mindset to improve operational efficiencies and ability to influence change, with a primary focus on client needs.
• You use critical thinking skills to recognize assumptions, evaluate arguments, draw conclusions and proactively propose solutions.
• You have strong communication skills to clearly convey messages and explore diverse points of view.
• You build trusting relationships and provide guidance to support the development of colleagues.
  
  
  

To Join Our Team

• 8+ years of progressive experience in data engineering with experience in building modern data platforms and data products.
• 5+ years of experience with distributed computing (ex. Spark) and infrastructure as code (ex. Terraform).
• 5+ years of experience designing and implementing scalable, cloud-based data solutions (Azure preferred).
• Deep understanding of data modeling, ETL processes, data warehousing concepts, and best practices in data engineering and analytics.
• Knowledge of cloud security and networking is an asset.
• Knowledge of infrastructure automation tools such as Terraform is an asset.
• Hands-on experience with machine learning technologies is an asset (ex. Azure ML).
• Hands-on experience with the following Azure PaaS is an asset: Azure Data Lake Storage (ADLS), Azure Databricks, Microsoft Fabric, Azure Data Factory (ADF), Azure Synapse, Event Hub, API Management (APIM), Azure Key Vault, Azure SQL, and Purview. Have a good understanding of the backup, disaster recovery, and data recovery strategy and execution with the above services.
• Excellent project management skills with the ability to prioritize and manage multiple priorities simultaneously.
• Excellent verbal and written communication skills with experience presenting to large and small audiences.
• Ability to interact with peers and stakeholders to define and drive product and business impact.
  
  
  

What You Need To Know

• You will travel regularly.
• You will be subject to a Background check as a condition of employment, in the event you are the successful candidate.
  
  
  

What’s in it for you?

• Training and development opportunities to grow your career.
• Flexible work options and paid time off to support your personal and family needs.
• A holistic approach to your well-being, with physical and mental health programs and a supportive workplace culture.
• Paid volunteer days to give back to your community.
• In addition to our competitive salary and incentive programs, eligible employees also benefit from a comprehensive total rewards package including group retirement savings plans, pension and benefits (e.g., health and wellness, dental, disability and life coverage), mental health support and an employee assistance program.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

Referrals increase your chances of interviewing at Co-operators by 2x

Sign in to set job alerts for “Data Specialist” roles.

Support Applications Engineer – Guelph, ON Canada

Intern Assistant Engineer - AI Inference Performance

Software Engineer I (Merchant Data Platform)

Co-op Student – Technology Specialist (Developer)

Co-op Student – Technology Specialist (Junior Software Developer)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.