RQ09067 - Software Developer - ETL - Senior

Rubicon Path; Toronto; On-site; CAD 95,000 - 130,000; Full time

Job summary

Rubicon Path is seeking a Senior ETL Developer to design and implement complex data pipelines using Azure Data Factory, Informatica PowerCenter, and SQL Server technologies. You will develop data models, optimize ETL processes, and ensure data quality across Azure Synapse environments.

The role involves collaborating with IT teams during the SDLC, delivering design documents, and enabling smooth deployment through CI/CD pipelines. Strong experience in Oracle PL/SQL and BI tools is required.

Qualifications

• Must have extensive experience gathering requirements and business process knowledge to design high-quality data transformations.
• Experience with Azure Data Factory, Databricks development and related runtime components.
• Familiarity with Informatica workflows and BI tools like Cognos and Power BI.
• Proficiency in CI/CD practices and Azure DevOps workflows.
• Strong SQL, Oracle PL/SQL, and Azure SQL DB/Synapse knowledge.

Responsibilities

• Review project artefacts such as Use Case and System Requirement Specifications.
• Deliver detailed system design documents per Ministry standards.
• Design data models using appropriate tools.
• Implement ETL/ELT pipelines with ADF, stored procedures, and Informatica PowerCenter.
• Develop Logic App and Function App solutions.
• Create structured JSON outputs using ADF/SQL.

Skills

Requirements gathering

Business process knowledge

RAD methodologies

Collaboration with stakeholders

Tools

Azure Data Factory

Databricks

Informatica PowerCenter

Logic Apps

Function App

Azure DevOps

Power BI

Cognos

Oracle PL/SQL

Azure Synapse

SQL Server

Job description

RQ09067 - Software Developer - ETL - Senior

About the job RQ09067 - Software Developer - ETL - Senior

Description

Scope of Services and Deliverables - The Services and Deliverables to be provided by the Vendor will include the following:

• Participate in the review of project, work request and maintenance release artefacts - Use Case, System Requirement Specification, etc.
• Deliver detailed system design documents and any other supporting documentation conforming to Ministry standards.
• Design logical and physical data models using Sybase Power Designer.
• Implement data pipelines using Azure Data Factory (ADF), stored procedure, and Informatica PowerCenter performing extraction, transformation, and loading activities.
• Implement solutions using Logic App and Function App.
• Generate structured JSON file using ADF/ SQL.
• Develop Azure CI/CD pipeline to automate ADF release.
• Develop complex Oracle PL/SQL program to fulfill project requirements.
• Implement complex data conversion, e.g., binary to character, EBCDIC to UTF.
• Implement complex data transformation(s) for derived and calculated values.
• Integrate data sets from diverse source systems.
• Implement ADF for initial data load and incremental load.
• Promote ADF and Informatica ETL/ELT through all Ministry environments including Development, Integration Testing, QA, UAT, Production.
• Resolve and troubleshoot ADF pipeline, stored procedure, and Informatica workflow technical problems.
• Monitor and analyze incident, provide timely resolution.
• Collaborate with IT Professionals throughout the Software Development Life Cycle.
• Document information from diverse business area stakeholders and subject matter experts.
• Optimize performance of ADF pipeline, Azure SQL and Synapse databases, and Informatica workflow.
• Monitor application functionality and performance on daily basis.
• Provide effective knowledge transfer to Ministry staff at all stages of this assignment.

Must haves:Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation.

SkillsExperience and Skill Set Requirements

Evaluation Table

ETL Development-Data Integration 40%

• Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation.
• Extensive experience in design, development, and implementation with Azure Data Factory, Databricks, including:
• Self-Hosted Integration Runtime
• Performance tuning on large data volumes
• Complex data transformations
• ADF Debugger to validate data transformation.
• Experience with Informatica, including:
• Workflow Manager
• Repository Manager
• Designer
• Workflow Monitor
• Experience with developing solutions using Logic App and Function App.
• Experience in rapid application development (RAD) methodologies.
• Experience in maintaining and improving existing ETL processes.
• Experience in investigating data to identify potential issues within ETL pipelines.
• Experience with Business Intelligence tools IBM Cognos and Microsoft PowerBI.
• Experience with CI/CD (DevOps) pipelines and concepts, including:
• Branching, pull requests, build, release, multiple parallel development repositories merge.
• Experience with Azure DevOps, including:

Oracle PL/SQL Development 10%

• Extensive experience in designing and developing SQL Server Stored Procedure, Oracle PL/SQL programs.

Database Technologies 10%

• Experience with Oracle, Microsoft SQL Server database and tools.
• Experience with relational and hierarchical database technologies.
• Extensive knowledge of Azure SQL DB and Synapse platforms, including:
• Performance tuning on large data volume