Senior Data Engineer - Public Sector, Security Clearance

Systematix group; Ottawa; On-site; CAD 95,000 - 130,000; Full time

Job summary

A technology consulting firm is seeking a Senior Data Engineer in Ottawa, Ontario. The role involves leading the delivery of data in cloud-native technologies and building robust data pipelines on a data and analytics platform. Candidates should have substantial experience in Spark, Python, and Azure technologies. Responsibilities include collaborating with stakeholders and ensuring effective data governance. This is a 1-year contract starting January 2025, ideal for individuals holding a security clearance.

Qualifications

• Proven design, build and implementation of batch and real-time data pipelines.
• Experience developing and proposing design patterns that conform to requirements.
• Experienced collaboration working with various stakeholders across the business.

Responsibilities

• Lead the delivery of data on data and analytics platform.
• Increase speed in which data is onboarded to the Data and Analytics platform.
• Build robust data pipelines to enable larger data consumption.

Skills

Programming experience in Spark using modern languages like Python, Scala

Experience with modern data architectures like Azure Data Lake

Experience in leading Data Engineering principles

Experience with Integration patterns and technologies

Knowledge of database modeling techniques

Experience with streaming data architecture for real-time

Experience with relational and non-relational databases

Experience with source code and configuration management

Job description

A technology consulting firm is seeking a Senior Data Engineer in Ottawa, Ontario. The role involves leading the delivery of data in cloud-native technologies and building robust data pipelines on a data and analytics platform. Candidates should have substantial experience in Spark, Python, and Azure technologies. Responsibilities include collaborating with stakeholders and ensuring effective data governance. This is a 1-year contract starting January 2025, ideal for individuals holding a security clearance.