Senior Data Platform Engineer (Hybrid, Azure/Databricks)

The Co-operators Group; Guelph; Hybrid; CAD 110,000 - 150,000; Full time

Job summary

CGIC is seeking a Sr Data Engineering Developer to design, develop and optimize data products and enterprise data solutions. You will independently manage data pipelines, APIs and analytics, while guiding junior colleagues and collaborating with stakeholders across IT and business units.

The ideal candidate has 3–5 years in data-adjacent roles and 3+ years in data engineering with Azure solutions, Databricks, PySpark and OpenAI API exposure.

Qualifications

• You have a degree in Computer Science, Information Systems, or related field is required. An advanced degree is an asset.
• You have 3-5 years of experience in Data-adjacent role.
• You have 3+ years of experience in data engineering with experience in building modern data platforms and data products, along with designing, developing and supporting data or software solutions.
• You have 3+ years of experience implementing data solutions (Azure preferred).
• You have advanced knowledge of data modeling, ETL processes, data warehousing concepts, and best practices in data engineering and analytics.
• You have hands-on experience with Python, ADLS, Azure Synapse SQL, Purview, OpenAI API, Pandas/Polars, REST APIs, OOP and concurrent application design.
• Having experience with Databricks and PySpark would be considered an asset.
• You have strong ability to evaluate technical challenges and translate business requirements into technical outcomes.

Responsibilities

• Design, develop and optimize data products and enterprise data solutions.
• Manage data pipelines, APIs and analytics solutions with autonomy and mentor juniors.
• Use DevOps platforms (GitHub) and manage infrastructure deployments through code (Terraform).
• Configure and use CI/CD pipelines and Databricks environments to develop and deploy data solutions.
• Promote security requirements on platforms and environments used by data solutions.
• Deliver production-ready code and reusable approaches to reduce technical debt.
• Collaborate with business and technology stakeholders to drive business value.

Skills

Data modeling

Data pipelines

ETL

SQL

Cloud data engineering

CI/CD

Education

Bachelor's in Computer Science / Information Systems

Tools

Python

Azure Data Lake Storage

Azure Synapse

Purview

OpenAI API

Pandas/Polars

REST APIs

Databricks

PySpark

Job description

CGIC is seeking a Sr Data Engineering Developer to design, develop and optimize data products and enterprise data solutions. You will independently manage data pipelines, APIs and analytics, while guiding junior colleagues and collaborating with stakeholders across IT and business units.

The ideal candidate has 3–5 years in data-adjacent roles and 3+ years in data engineering with Azure solutions, Databricks, PySpark and OpenAI API exposure.