RQ10949 - Sr. Software Developer - ETL

Source Code; Toronto; On-site; CAD 121,000 - 146,000; Full time

Job summary

Source Code is seeking a Sr. Software Developer - ETL to migrate files to an OpenText-based document system and move historical data into a data warehouse. You will design data models, build data assets in a lakehouse, and deliver PowerBI dashboards.

The role requires 5+ years in ETL, strong Azure Synapse and Dynamics experience, and proficiency with SQL Server/Oracle/Azure SQL. It is onsite in Toronto with a focus on data governance and performance optimization.

Qualifications

• 5+ years of proven ETL experience and strong ETL pattern knowledge.
• Experience with Azure Synapse workspaces, data flows, triggers and monitoring.
• Knowledge of Dynamics DataVerse/CDS, Data Entities, and APIs.
• Proven experience with Dynamics 365 CE and Dynamics 365 F&O as ETL developer.
• Hands-on experience with SQL Server, Oracle, and Azure SQL Databases.
• Proficiency in Python.

Responsibilities

• Migrate digital files to OpenText-based document management solution.
• Migrate historical data from legacy systems to data warehouse/lakehouse.
• Build data assets in the lakehouse and create PowerBI reports.
• Design data warehouse/lakehouse architecture and data models.
• Develop and automate ETL processes to load data from external solutions.
• Ensure data security and governance for reports and datasets.
• Optimize performance of data warehouse and reporting processes.

Skills

ETL principles

Azure Synapse

Dynamics DataVerse/CDS/APIs

Dynamics 365 CE & D365 FO

SQL Server

Oracle

Azure SQL Database

Python

Tools

Power BI

Job description

About the job RQ10949 - Sr. Software Developer - ETL

RQ10949 - Sr. Software Developer - ETL

ONSITE 5 days -21 College Street

Security Level: CRJMC + Credit Check

Must-haves:

• 5+ years of proven working experience in an ETL role; strong understanding of ETL principles, including data extraction, transformation, and loading processes; knowledge of common ETL design patterns. Understanding of data pipeline architectures, Azure workflow orchestration tools, and concepts related to data ingestion, transformation, and movement.
• Proficiency in Azure Synapse workspaces, including knowledge of pipeline creation, data flows, integration runtimes, triggers, and monitoring.
• Knowledge of integration technologies commonly used with Dynamics, such as DataVerse / Common Data Service (CDS), Data Entities, and APIs.
• Proven experience working with data from Dynamics 365 CE and Dynamics 365 F&O as an ETL developer
• Demonstrated experience with SQL Server, Oracle, Azure SQL Databases
• Python

Scope:

The Office of the Public Guardian and Trustee (OPGT) requires a Senior Software Developer to migrate digital files to an OpenText based document management solution, migrate historical data from legacy systems to a data warehouse/lakehouse, to build data assets in the lakehouse, and to create PowerBI reports.

As a member of the data team, you will be responsible for the migration of digital files to an enterprise OpenText based document management solution, the migration of historical data from legacy systems to a data warehouse/lakehouse, building data assets in the lakehouse, and creating PowerBI reports. A high-level list of deliverables for the data migration team follows:

• Data Warehouse Design: analyze business requirements and the data warehouse/lakehouse/golden layer on Microsoft Azure
• Data extraction: Identify/define data to be extracted and migrated to the data warehouse/lakehouse or document storage solution
• Data Integration and ETL: help develop and automate ETL processes to load data from external solutions into the data warehouse/lakehouse (bronze/silver/golden layers) and integrate data into the data warehouse.
• Digital file migration: Identify/define data/files to be extracted and migrated to the OPGT's OpenText based document management solution
• Data Integration and ETL: help develop and automate ETL processes to load digital files from external storage solutions into the enterprise OpenText based document storage solution
• Data Modeling: create logical and physical data models that align with the project's reporting and analytical needs.
• Data Security and Governance: implement appropriate security controls to protect sensitive data within the data warehouse and reports.
• Reporting and Visualization: develop reports, dashboards and visualizations as per reporting MVP. Ensure the quality, accuracy and integrity of reports.
• Performance Optimization: fine-tune the data warehouse and reporting processes to optimize query performance and overall system efficiency.
• Other duties as assigned.

You will also be required to:

• Complete work and achieve milestones within the assigned deadlines.
• Notify the Cluster/Ministry project Manager in writing of any issues or other material concerns related to the Assignment Deliverables, as soon as he/she becomes aware of them
• Submit Deliverables for the Cluster/Ministry approval as they are completed.
• Comply with the Ontario Government and the Cluster/Ministry security procedures and practices
• Comply with the Ontario Government and the Cluster/Ministry architecture/technology standards and best practices
• Comply with the Ontario Government and the Cluster/Ministry Conflict of Interest and Confidentiality Guidelines
• Provide knowledge and skill transfer to a designated Cluster/Ministry staff
• Comply with the Ontario Government I&IT Directive, Operational Policy on the I&IT Project Gateway Process, and other applicable Guidelines, Standards and Procedures.

AI Disclaimer: Source Code may use artificial intelligence (AI) tools to assist in certain aspects of its recruiting and business operations.

Note: The higher end of the range is intended for absolutely exceptional candidates who meet all must-have requirements and most or all nice-to-have qualifications. The client will evaluate candidates based on both rate expectations and overall skill set when shortlisting.

• $88.63/hr - $106.36/hr Inc.