Senior Data Engineer — Cloud Data & AI Platforms

Insight Public Sector; Toronto; Hybrid; CAD 120,000 - 140,000; Full time

Job summary

Insight Public Sector is seeking a Senior Data Engineer to design, build, and optimize modern data platforms that enable analytics, reporting, operational intelligence, and AI‑driven solutions. You will develop scalable data pipelines across cloud environments, integrating complex sources and delivering high‑quality data solutions.

The role requires collaboration with architects, engineers, analysts, and stakeholders to modernize data environments and implement cloud‑based platforms.

Qualifications

• 6+ years of experience in Data Engineering, Data Integration, Analytics Engineering, or related field.
• Advanced SQL skills, including optimization and data modeling.
• Experience with Python, Scala, Java, or similar languages.
• Experience with cloud data platforms, data warehouses, lakehouses, analytics environments.
• Experience with distributed processing technologies (Spark).
• Hands-on experience with modern data platforms (Fabric, Databricks, Snowflake, BigQuery, Redshift).
• Familiarity with Git-based workflows and CI/CD.
• Understanding of data quality, governance, lineage, security, and observability.
• Strong communication with technical and non-technical stakeholders.
• Ability to adapt to changing priorities and learn new tech quickly.

Responsibilities

• Design, develop, and maintain scalable data pipelines ingesting data from varied sources.
• Build and support ETL/ELT solutions across cloud data platforms and analytics environments.
• Develop data integration frameworks for secure, efficient data movement.
• Design dimensional models and data structures for analytics and AI initiatives.
• Collaborate with architects and stakeholders to translate business requirements into scalable solutions.
• Apply data quality, testing, monitoring, lineage, and governance practices throughout the lifecycle.
• Optimize pipelines for performance, scalability, and cost efficiency.
• Support modernization of legacy data platforms and integrations.
• Implement CI/CD, automation, and source control in data engineering workflows.
• Troubleshoot complex issues across data platforms and integration environments.
• Contribute to architecture reviews and continuous improvement.

Skills

SQL

Python/Scala/Java

Cloud data platforms

ETL/ELT pipelines

Spark

Git & CI/CD

Data governance & lineage

Data modeling

Communication

Problem solving

Education

Bachelor's degree in Computer Science/Engineering

Tools

Microsoft Fabric

Databricks

Snowflake

BigQuery

Redshift

Job description

Insight Public Sector is seeking a Senior Data Engineer to design, build, and optimize modern data platforms that enable analytics, reporting, operational intelligence, and AI‑driven solutions. You will develop scalable data pipelines across cloud environments, integrating complex sources and delivering high‑quality data solutions.

The role requires collaboration with architects, engineers, analysts, and stakeholders to modernize data environments and implement cloud‑based platforms.