RQ08687 - Software Developer - ETL - Senior

Rubicon Path; Toronto; On-site; CAD 80,000 - 120,000; Full time

Job summary

A leading company in data solutions seeks a Senior Software Developer specializing in ETL processes for project implementation. The role involves designing and optimizing data pipelines, ensuring high-quality data transformations, and collaborating with IT teams. This challenging position offers opportunities for knowledge transfer and professional growth within a dynamic environment.

Qualifications

• Extensive experience in requirements gathering and designing high-quality data transformations.
• Experience with Azure Data Factory, Informatica, and Oracle PL/SQL development.
• Ability to troubleshoot ETL pipelines and optimize performance.

Responsibilities

• Design and implement ETL processes using Azure Data Factory and Informatica.
• Develop complex SQL Server Stored Procedures and Oracle PL/SQL programs.
• Collaborate with IT professionals throughout the software development lifecycle.

Skills

ETL Development

Data Integration

Azure Data Factory

Informatica

Oracle PL/SQL

SQL Server Stored Procedures

Performance Tuning

Business Intelligence

CI/CD

Collaboration

Education

Bachelor's Degree in Computer Science or related field

Job description

RQ08687 - Software Developer - ETL - Senior

About the job RQ08687 - Software Developer - ETL - Senior

Description

Scope of Services and Deliverables - The Vendor will provide:

• Review of project, work request, and maintenance release artefacts such as Use Case, System Requirement Specification, etc.
• Delivery of detailed system design documents and supporting documentation adhering to Ministry standards.
• Design of logical and physical data models using Sybase Power Designer.
• Implementation of data pipelines using Azure Data Factory (ADF), stored procedures, and Informatica PowerCenter for extraction, transformation, and loading activities.
• Solution implementation using Logic App and Function App.
• Generation of structured JSON files using ADF/SQL.
• Development of Azure CI/CD pipelines for automating ADF releases.
• Development of complex Oracle PL/SQL programs as required.
• Implementation of complex data conversions and transformations.
• Integration of datasets from diverse source systems.
• Implementation of ADF for initial and incremental data loads.
• Promotion of ADF and Informatica ETL/ELT across all Ministry environments.
• Troubleshooting and resolution of technical issues in ADF pipelines, stored procedures, and Informatica workflows.
• Monitoring, analyzing incidents, and providing timely resolutions.
• Collaboration with IT professionals throughout the SDLC.
• Documentation of information from business stakeholders and subject matter experts.
• Performance optimization of ADF pipelines, Azure SQL, Synapse databases, and Informatica workflows.
• Daily monitoring of application functionality and performance.
• Knowledge transfer to Ministry staff at all stages.

Skills, Experience, and Skill Set Requirements

Evaluation Table

ETL Development-Data Integration 40%

• Extensive experience in requirements gathering and designing high-quality data transformations.
• Proficiency in Azure Data Factory, Databricks, including Self-Hosted Integration Runtime, performance tuning, complex data transformations, and debugging.
• Experience with Informatica tools: Workflow Manager, Repository Manager, Designer, Workflow Monitor.
• Experience developing solutions using Logic App and Function App.
• Experience with rapid application development methodologies.
• Experience maintaining and improving ETL processes.
• Ability to investigate data issues within ETL pipelines.
• Experience with BI tools like IBM Cognos and Microsoft PowerBI.
• Knowledge of CI/CD pipelines and Azure DevOps, including branching, pull requests, and release management.

Oracle PL/SQL Development 10%

• Extensive experience designing and developing SQL Server Stored Procedures and Oracle PL/SQL programs.

Database Technologies 10%

• Experience with Oracle, Microsoft SQL Server, and related tools.
• Knowledge of relational and hierarchical database technologies.
• Experience with Azure SQL DB and Synapse platforms, including performance tuning.

Req Closing Date/Time: 2025-03-26, 12:30 p.m. Max number of candidate submissions: 1. Candidate must attend office 3 days a week. Must haves: Extensive experience in requirements gathering and designing high-quality data transformations.