Software Developer ETL 9197-3010

Dheya; Toronto; Hybrid; CAD 60,000 - 100,000; Full time

Job summary

An innovative firm is seeking a skilled Data Engineer to join their dynamic Data Management team. This hybrid role offers the opportunity to work closely with business clients, developing and maintaining ETL processes and database applications. You will engage with various data sources, ensuring compliance and scalability while leveraging cutting-edge cloud technologies. Ideal candidates will possess strong problem-solving skills and experience with AWS and ETL tools. If you are passionate about data management and thrive in a collaborative environment, this role is perfect for you.

Qualifications

• Experience with AWS suite and ETL processes.
• Strong communication skills for effective collaboration.

Responsibilities

• Support cross-functional data initiatives with business clients.
• Develop ETL processes and ensure data integrity.

Skills

ETL Tools (Talend, Informatica)

SQL and Database Management

Data Warehousing Concepts

Problem Solving Skills

Data Modeling

Python or Java Programming

Version Control Systems (Git)

Cloud Technologies (AWS, Azure)

Agile Methodologies

Tools

Azure Data Factory

AWS Glue

AWS Kinesis Data Firehose

AWS SageMaker

OpenSearch

Job description

Skills Required :

• ETL Tools e.g. Talend, Informatica
• SQL and Database Management
• Data Warehousing Concepts
• Problem Solving Skills
• Data Modeling
• Python or Java Programming
• Version Control Systems e.g. Git
• Cloud Technologies e.g. AWS or Azure
• Agile Methodologies

HM Note: This hybrid contract role is three (3) days in office. Candidates' resumes must include first and last name.

Description

Responsibilities:

• Work as an integrated member of the Data Management team to support cross-functional data initiatives with various business clients.
• Interact with Business teams to understand technical functionalities, requirements, and analyze data requirements and their impact on existing systems.
• Connect various source and target systems (Oracle, Microsoft, Amazon Aurora, Amazon RDS, databases, APIs, flat files, etc.) and perform ETL activities.
• Develop ETL processes within Azure Data Factory or AWS equivalents such as Glue, Kinesis Data Firehose, SageMaker, Data Wrangler, OpenSearch, etc., and SQL code to meet business needs.
• Execute unit tests to ensure accuracy of code changes and verify data integrity and performance requirements.
• Participate in meetings and scrums, work on incident and enhancement tickets, and provide technical support.

Experience and Skill Set Requirements

Design, develop, and maintain database back-end and ETL applications for Data Warehouse and Business Intelligence solutions, ensuring scalability, standards compliance, and documentation.

Mandatory Skills:

• Experience with AWS suite: Amazon Aurora, Amazon RDS, Glue, OpenSearch, etc.
• Developing data extraction, transformation, and load programs for various data repositories.
• Developing, implementing, and maintaining ETL schedule/dependency logic.
• Data modeling and design principles for data marts and warehouses.
• Experience with Git and source control strategies.
• Creating technical documentation like ETL mappings, data model diagrams, architecture artifacts, and detailed design documents.
• Software development lifecycle experience.
• Strong communication skills for clear and effective verbal and written communication.

Nice to Have Skills:

• Knowledge of AODA regulations and standards.
• Programming in C# and developing APIs, functions, etc.
• Scripting with PowerShell and other scripting languages.

Evaluation Criteria:

Core Technical Skills (50%), Other Technical Skills (35%), Communication Skills (10%), Standards and Best Practices (5%).