RQ10944 - 2 x Sr. Software Developer - ETL

Source Code; Toronto; On-site; CAD 123,000 - 146,000; Full time

Job summary

Source Code in Toronto is seeking a Senior Software Developer (ETL) to migrate digital files to an OpenText-based document management system and move historical data into a data warehouse/lakehouse on Microsoft Azure.

You will design data models, build data assets in the lakehouse, automate ETL processes, and develop PowerBI reports to deliver reporting MVP. Strong ETL, Azure Synapse, and Dynamics integration experience are required.

Qualifications

• 5+ years of proven experience in an ETL role and solid ETL principles.
• Knowledge of data extraction, transformation, and loading processes and patterns.
• Understanding of data pipeline architectures, Azure workflow tools, and data ingestion/movement concepts.

Responsibilities

• Migrate digital files to an OpenText-based document management solution.
• Migrate historical data from legacy systems to a data warehouse/lakehouse.
• Build data assets in the lakehouse and create PowerBI reports.
• Data Warehouse design and data modeling to support reporting needs.
• Develop and automate ETL processes to load data into the warehouse/lakehouse.
• Implement data security and governance for stored data and reports.
• Optimize performance of data and reporting pipelines.

Skills

ETL principles

Azure Synapse

Dynamics DataVerse/CDS

Dynamics 365 CE/FO

SQL Server/Oracle/Azure SQL

Python

Job description

RQ10944 - 2 x Sr. Software Developer - ETL

About the job RQ10944 - 2 x Sr. Software Developer - ETL

RQ10944 - 2 xSr. Software Developer - ETL

2 opening - 2 submissions

ONSITE 5 days -21 College Street

Security Level: CRJMC + Credit Check

Must-haves:

• 5+ years of proven working experience in an ETL role; strong understanding of ETL principles, including data extraction, transformation, and loading processes; knowledge of common ETL design patterns. Understanding of data pipeline architectures, Azure workflow orchestration tools, and concepts related to data ingestion, transformation, and movement.
• Proficiency in Azure Synapse workspaces, including knowledge of pipeline creation, data flows, integration runtimes, triggers, and monitoring.
• Knowledge of integration technologies commonly used with Dynamics, such as DataVerse / Common Data Service (CDS), Data Entities, and APIs.
• Proven experience working with data from Dynamics 365 CE and Dynamics 365 F&O as an ETL developer
• Demonstrated experience with SQL Server, Oracle, Azure SQL Databases
• Python

Scope:

The Office of the Public Guardian and Trustee (OPGT) requires a Senior Software Developer to migrate digital files to an OpenText based document management solution, migrate historical data from legacy systems to a data warehouse/lakehouse, to build data assets in the lakehouse, and to create PowerBI reports.

As a member of the data team, you will be responsible for the migration of digital files to an enterprise OpenText based document management solution, the migration of historical data from legacy systems to a data warehouse/lakehouse, building data assets in the lakehouse, and creating PowerBI reports. A high-level list of deliverables for the data migration team follows:

• Data Warehouse Design: analyze business requirements and the data warehouse/lakehouse/golden layer on Microsoft Azure
• Data extraction: Identify/define data to be extracted and migrated to the data warehouse/lakehouse or document storage solution
• Data Integration and ETL: help develop and automate ETL processes to load data from external solutions into the data warehouse/lakehouse (bronze/silver/golden layers) and integrate data into the data warehouse.
• Digital file migration: Identify/define data/files to be extracted and migrated to the OPGT's OpenText based document management solution
• Data Integration and ETL: help develop and automate ETL processes to load digital files from external storage solutions into the enterprise OpenText based document storage solution
• Data Modeling: create logical and physical data models that align with the project's reporting and analytical needs.
• Data Security and Governance: implement appropriate security controls to protect sensitive data within the data warehouse and reports.
• Reporting and Visualization: develop reports, dashboards and visualizations as per reporting MVP. Ensure the quality, accuracy and integrity of reports.
• Performance Optimization: fine-tune the data warehouse and reporting processes to optimize query performance and overall system efficiency.
• Other duties as assigned.

You will also be required to:

• Complete work and achieve milestones within the assigned deadlines.
• Notify the Cluster/Ministry project Manager in writing of any issues or other material concerns related to the Assignment Deliverables, as soon as he/she becomes aware of them
• Submit Deliverables for the Cluster/Ministry approval as they are completed.
• Comply with the Ontario Government and the Cluster/Ministry security procedures and practices
• Comply with the Ontario Government and the Cluster/Ministry architecture/technology standards and best practices
• Comply with the Ontario Government and the Cluster/Ministry Conflict of Interest and Confidentiality Guidelines
• Provide knowledge and skill transfer to a designated Cluster/Ministry staff
• Comply with the Ontario Government I&IT Directive, Operational Policy on the I&IT Project Gateway Process, and other applicable Guidelines, Standards and Procedures.

AI Disclaimer: Source Code may use artificial intelligence (AI) tools to assist in certain aspects of its recruiting and business operations.

Note: The higher end of the range is intended for absolutely exceptional candidates who meet all must-have requirements and most or all nice-to-have qualifications. The client will evaluate candidates based on both rate expectations and overall skill set when shortlisting.

• $88.63/hr - $106.36/hr Inc.