About the job RQ07957 - Sr. Software Developer - ETL
Responsibilities
- Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities.
- Required to translate technical systems specifications into working, tested applications. This includes developing detailed programming specifications, writing and/or generating code, compiling data-driven programs, maintaining, and conducting unit tests.
- Resolves and troubleshoots technical problems which arise during the use and operation of software packages, including technical assistance in implementation, conversion and migrations.
General Skills
- Experience in programming and analysis; specialized software package support at the specified experience level
- Ability to collaborate with IT Professionals throughout the Software Development Life Cycle
- Experience in structured methodologies for the development, design, implementation and maintenance of applications
- Experience in design, code, test, debug and document applications
- Experience in the use of object and/or third generation language development tools
- Experience in one or more programming languages
- Experience in application design, latest design patters, deployment and troubleshooting
- Experience with relational and hierarchical database technologies
- Experience in the use of information retrieval packages using query languages
- Experience with one or more communications protocols
- Experience eliciting and documenting information from diverse business area stakeholders and subject matter experts
- Excellent analytical, problem-solving and decision-making skills; verbal and written communication skills; interpersonal and negotiation skills
- A team player with a track record for meeting deadlines
ETL Skills
- Knowledge and experience in gathering requirements and business process knowledge in order to transform the data in a way that’s geared towards the needs of end users
- Knowledge and experience maintaining and improving already existing processes.
- Knowledge and experience ensuring that the data architecture is scalable and maintainable
- Knowledge and experience working with the business in designing and delivering correct, high quality data
- Experience investigating data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions
- Experience preparing detailed documentation for further reference
- Knowledge and experience with programming Internet-ready applications
- Knowledge and experience in rapid application development (RAD) methodologies
- Knowledge and understanding of Information Management principles, concepts, policies and practices
- Experience with middleware and gateways
- Experience reviewing, analyzing, and modifying product installation scripts including encoding, testing, debugging
- Ability to provide post-implementation support and resolve any post-implementation technical issues
- Experience conducting design walkthrough sessions with project team
- Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards
- Ability to provide user and system documentation as required
Skills Experience and Skill Set Requirements
Core Technical Skills - 45%
- Demonstrates 5 - 10 years of experience designing, developing, and implementing ETL solutions using Azure Data Factory.
- Demonstrates development and solution design experience in an environment where Azure Data Factory, and PowerBI are used together
- Experience in designing data warehouses and data marts for databases such as Oracle, SQL Server, Azure Blob, Azure SQL Database as well as having a strong understanding of the architectural implications associated with each platform in regard to ETL
- Experience in debugging mappings, transformations, mapplets, source qualifier files and queries
- Demonstrates experience with developing ETL solutions to populate data warehouses and create data extracts for the purpose of business intelligence reporting
- Demonstrates experience developing star schema multi-dimensional models
- Experience with developing, debugging and enhancing the performance of complex SQL queries
- Demonstrates experience using Power Designer to review data models, as well as make changes and generate DDL scripts
- Demonstrates experience developing application code package using Azure DevOps
- Demonstrates development experience with SQL Server 2016+, Azure Blob and Azure SQL Database, Oracle 12.x
- Demonstrates experience with documenting code changes, creating release packages and deployment instructions
- Experience with performing unit testing and conducting System Integration Testing and User Acceptance Testing
- Demonstrated Experience with Informatica and Powercenter would be an asset
General skills/experience - 35%
- Working knowledge of aggregate reporting
- Demonstrates experience supporting business users working on projects or programs involving multiple highly inter-dependent applications and/or data sources
- Demonstrates experience developing application code package using Azure DevOps
- Demonstrates experience implementing star schema multi-dimensional models and documenting detailed design models
- Demonstrates development and design experience with SDLC processes, Agile and Waterfall methodologies
- Demonstrates experience with documenting code changes and deployment instructions
- Experience with performing unit testing and conducting System Integration Testing and User Acceptance Testing
- Analytical and problem-solving skills to assess clients business priorities and needs; to evaluate business and technical design alternatives
Communications Skills/experience - 15%
- Analytical and problem-solving skills to assess clients business priorities and needs; to evaluate business and technical design alternatives
- Demonstrates the ability to collaboratively work with other groups (both technical and business) to ensure optimal solution integration
- Demonstrates ability to communicate day-to-day task and issue tracking, reporting and facilitating resolution of issues and risks for all project activities
- Demonstrates ability in providing input to changes required to business and/or system requirements, change requests, project artefacts, well as requirement gathering sessions
- Experience with documenting, consulting and presenting for a diverse audience of stakeholders (both technical and non-technical)
- Experience with liaising with IT specialists and unit leads and working closely with support team members and relevant stakeholders
- Strong analytical, problem-solving, and decision-making skills; verbal and written communication skills; interpersonal and negotiation skills
- Demonstrates experience working collaboratively, with the ability to coordinate multiple projects with competing priorities and a track record for meeting strict deadlines
Public Sector Experience -5%
- Previous experience in an organization of equivalent size and complexity to the Public Sector.
- Demonstrates experience designing and developing applications that comply with GO-ITS standards would be an asset
Must Have
- 7+ years
- Demonstrates 5 - 10 years of experience designing, developing, and implementing ETL solutions using Azure Data Factory.
- Demonstrates development and solution design experience in an environment where Azure Data Factory, and PowerBI are used together
- Experience in designing data warehouses and data marts for databases such as Oracle, SQL Server, Azure Blob, Azure SQL Database as well as having a strong understanding of the architectural implications associated with each platform in regard to ETL