Job Search and Career Advice Platform

Enable job alerts via email!

Senior Data Engineer

Systematix group

Ottawa

On-site

CAD 95,000 - 130,000

Full time

Today
Be an early applicant

Generate a tailored resume in minutes

Land an interview and earn more. Learn more

Job summary

A technology consulting firm is seeking a Senior Data Engineer in Ottawa, Ontario. The role involves leading the delivery of data in cloud-native technologies and building robust data pipelines on a data and analytics platform. Candidates should have substantial experience in Spark, Python, and Azure technologies. Responsibilities include collaborating with stakeholders and ensuring effective data governance. This is a 1-year contract starting January 2025, ideal for individuals holding a security clearance.

Qualifications

  • Proven design, build and implementation of batch and real-time data pipelines.
  • Experience developing and proposing design patterns that conform to requirements.
  • Experienced collaboration working with various stakeholders across the business.

Responsibilities

  • Lead the delivery of data on data and analytics platform.
  • Increase speed in which data is onboarded to the Data and Analytics platform.
  • Build robust data pipelines to enable larger data consumption.

Skills

Programming experience in Spark using modern languages like Python, Scala
Experience with modern data architectures like Azure Data Lake
Experience in leading Data Engineering principles
Experience with Integration patterns and technologies
Knowledge of database modeling techniques
Experience with streaming data architecture for real-time
Experience with relational and non-relational databases
Experience with source code and configuration management
Job description

We are Systematix and we are looking for a Senior Data Engineer for an upcoming opportunity with a public sector client. The ideal candidate must already possess a security clearance at the Reliability level (Level I) or higher. The expected start date for this 1-year contract is January 2025.

About the Project

The Senior Data Engineer Service Provider will be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of building out data engineering practice cloud-native technologies. The Senior Data Engineer Service Provider must have experience in leading, designing, implementing, and collaborating with stakeholders to achieve the best results for our clients.

About the Responsibilities
  • Proven design, build and implementation of batch and real-time data pipelines. Driven by automated repeatable delivery of data that aligns to enterprise data governance standards.
  • Experience in developing and proposing design patterns that conform to requirements. Responsible to ensure the proposed design, optimally addresses access and query patterns; data consumption and adheres to internal architecture standards.
  • Experienced collaboration working with various stakeholders across the business, data scientists and IT. Working closely building relationships, refining data requirements to meet various data and analytics initiatives and data consumption requirements
  • Increase the overall speed in which data is onboarded to the Data and Analytics platform.
  • Building robust data pipelines to enable larger data consumption on the Data and Analytics Platform
  • Increase the overall quality of data pipeline development through DevSecOps
About the Qualifications
  • Programming experience in Spark using modern languages such as Python, Scala
  • Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes
  • Experience leading Data Engineering principles within an organization/team.
  • Experience working with Integration patterns and technologies such as Azure Event Hub, Function App and C#
  • Knowledge and expertise of database modeling techniques: Data Vaults, Star, Snowflake, 3NF, etc.
  • Experience working with streaming data architecture and technologies for real-time: Spark Streaming, Kafka, Flink, Storm
  • Experience working with relational and non-relational database technologies: SQL Server, Oracle, Cassandra, MongoDB, CosmosDB, HBase
  • Experience working with source code and configuration management environments such as Azure DevOps, Git, Maven, Nexus

Assets:

  • Experience within Azure environment
  • Strong Python, Scala and Spark experience
  • Experience modernizing data platforms.
  • Experience with Azure Functions and C#
  • 2 to 3 projects developing Data Vault

Candidates must outline in detail how they meet the above requirements.

At Systematix, our core values—excellence, collaboration, respect, and knowledge as a pursuit—underpin our commitment to fostering an inclusive and equitable environment. We encourage everyone to be their authentic selves, and we are committed to ensuring that our employment decisions are entirely based on job requirements and individual qualifications. We welcome applications from qualified candidates of all backgrounds, including but not limited to race, ethnicity, gender identity or expression, sexual orientation, disability, age, and religious beliefs. If our values and the position advertised resonate with you, we encourage you to apply.

Get your free, confidential resume review.
or drag and drop a PDF, DOC, DOCX, ODT, or PAGES file up to 5MB.