RQ09197 - Software Developer - ETL - Senior

Rubicon Path; Toronto; Hybrid; CAD 80,000 - 110,000; Full time

Job summary

An innovative firm is seeking a Senior ETL Developer to join their dynamic Data Management team. This role involves designing and maintaining ETL applications, working with both Azure and AWS technologies to support data initiatives across various business clients. The successful candidate will engage in developing scalable solutions, ensuring data integrity, and creating technical documentation. If you're passionate about data and eager to contribute to impactful projects in a hybrid work environment, this opportunity is perfect for you.

Qualifications

• 5+ years of experience in ETL development and data management.
• Strong knowledge of Azure and AWS technologies for data solutions.
• Proficient in SQL and data modeling for data warehouses.

Responsibilities

• Develop and maintain ETL applications for data integration.
• Collaborate with business teams to gather technical requirements.
• Create technical documentation and maintain data models.

Skills

Azure Data Factory

AWS (Amazon Web Services)

SQL

ETL Development

Data Integration

Data Cleansing

Data Modeling

Power BI

Git

Communication Skills

Education

Bachelor's Degree in Computer Science

Relevant Certifications (e.g., AWS Certified)

Tools

Azure SQL Database

Azure Data Lake

Amazon Aurora

OpenSearch

PowerShell

Job description

Description

Hybrid Work Environment: The successful candidate is expected to work onsite at 222 Jarvis St 3 days per week, and may work remotely up to 2 days per week.

Responsibilities:

• Work as an integrated member of the Data Management team to support cross functional data initiatives with various business clients
• Interact with Business teams to better understand the technical functionality requirements and analyze data requirements and their impact to the existing systems
• Responsible in connecting various source and target systems (Oracle, Microsoft and Amazon Aurora, Amazon Relational Database Services, databases, APIs, flat files, etc.) and performing Extract, Transform, and Load (ETL) activities
• Work with team members to develop ETL within Azure Data Factory or Amazon Web Services (AWS) equivalent such as Glue, Kinesis Data Firehose, SageMaker, Data Wrangler, OpenSearch Service, etc. and SQL code to satisfy business requirements
• Create ETL Mappings and develop stored procedures, SQL queries and tune/optimize SQL code the ETL process and the target database for reporting
• Execute unit tests to ensure the accuracy of code changes, and to verify that data integrity and performance requirements are met
• Participate in meetings and scrums, works on incident and enhancement/maintenance tickets assignments and delivers excellent technical support
• Create and maintains technical documents, including data models

SkillsExperience and Skill Set Requirements

Responsibilities/Assignment Deliverables Senior ETL Developer

Designs, develops, and maintains database back-end and ETL applications for Data Warehouse and Business Intelligence solutions. Uses knowledge of ETL languages and development techniques to build and expand application functionality by writing high-quality code using appropriate patterns. Ensures applications remain scalable while complying to standards and following best practices. Tests and debugs applications and ensures that software is properly documented. Collaborates clearly and professionally as part of a development team and communicates with clients.

Mandatory Skills:

• Experience with the Microsoft suite of technology including: Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI
• Experience with the Amazon Web Services (AWS) suite of technology including: Amazon Aurora, Amazon Relational Database Search, Glue, OpenSearch, etc.
• Experience with developing data extraction, transformation, and load programs (daily and initial load) functionality on a wide range of data repositories (structured and semi-structured files, relational and multi-dimensional data stores)
• Experience with developing, implementing, and maintaining schedule/dependency logic for Extract Transform Load (ETL) scripts
• Experience with data integration, data cleansing, and data analytics
• Experience with data modeling and design principles for data marts and data warehouses
• Experience in database management and administration
• Experience in constructing complex SQL queries and performance tuning
• Experience with Git and knowledge of source control strategies
• Experience creating technical documentation including ETL source-to-target mappings, data model diagrams, architecture artifacts, detailed design documents, etc.
• Experience in eliciting, documenting, and validating business requirements
• Experience in software development lifecycle from Development, to Testing and Quality Assurance, to Delivery
• Solid communications skills: the ability to understand, comprehend, and follow instructions and requirements to communicate clearly and effectively both verbally and in writing.

Nice to have skills:

• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards
• Experience designing visual dashboards to highlight trends and Key Performance Indicators (KPIs), and developing canned reports (scheduled and ad-hoc)
• Experience with programming languages such as C#, developing application code such as APIs, Functions, etc.
• Experience writing scripts with PowerShell and other scripting languages

Software Developer - Senior - Evaluation Criteria

Description

%

Core Technical Skills

• Experience with the Microsoft suite of technology including: Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI
• Experience with the Amazon Web Services (AWS) suite of technology including: Amazon Aurora, Amazon Relational Database Search, Glue, OpenSearch, etc.
• Experience with developing data extraction, transformation, and load programs (daily and initial load) functionality on a wide range of data repositories (structured and semi-structured files, relational and multi-dimensional data stores)
• Experience with developing, implementing, and maintaining schedule/dependency logic for Extract Transform Load (ETL) scripts
• Experience with data integration, data cleansing, and data analytics
• Experience with data modeling and design principles for data marts and data warehouses
• Experience in database management and administration
• Experience in constructing complex SQL queries and performance tuning
• Experience creating technical documentation including ETL source-to-target mappings, data model diagrams, architecture artifacts, detailed design documents, etc.

50%

Other Technical Skills

• Experience designing visual dashboards to highlight trends and Key Performance Indicators (KPIs), and developing canned reports (scheduled and ad-hoc)
• Experience with programming languages such as C#, developing application code such as APIs, Functions, etc.
• Experience writing scripts with PowerShell and other scripting languages
• Experience with Git and knowledge of source control strategies
• Experience in software development lifecycle from Development, to Testing and Quality Assurance, to Delivery

35%

Communications Skills

• Experience in eliciting, documenting, and validating business requirements
• Solid communications skills: the ability to understand, comprehend, and follow instructions and requirements to communicate clearly and effectively both verbally and in writing.

10%

Standards and Best Practices

• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards

5%

MUST HAVES:

· Experience with the Microsoft suite of technology including: Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI

· Experience with the Amazon Web Services (AWS) suite of technology including: Amazon Aurora, Amazon Relational Database Search, Glue, OpenSearch, etc.

· Experience with developing data extraction, transformation, and load programs (daily and initial load) functionality on a wide range of data repositories (structured and semi-structured files, relational and multi-dimensional data stores)

· Experience with developing, implementing, and maintaining schedule/dependency logic for Extract Transform Load (ETL) scripts

· Experience with data integration, data cleansing, and data analytics

· Experience with data modeling and design principles for data marts and data warehouses