Manager, Data Engineering

Yoush Consulting; Toronto; On-site; CAD 80,000 - 120,000; Full time

Job summary

An innovative consulting firm is seeking a talented Azure DevOps Engineer with a strong background in Data Engineering. In this role, you will build and maintain robust systems for data extraction, transformation, and loading within an Azure-based ecosystem. You will leverage your expertise in SQL, Python, and Azure technologies to optimize data processes and enhance performance. This is an exciting opportunity to work in a dynamic environment, where your contributions will directly impact the success of data-driven projects. If you are passionate about data engineering and thrive in a collaborative setting, this role is perfect for you.

Qualifications

• 5+ years of experience in Data Engineering with a focus on ETL processes.
• Strong knowledge of Azure technologies and data analysis techniques.

Responsibilities

• Review and assess enterprise data warehouse for scalability and performance.
• Design and develop SSIS ETL processes to improve data handling efficiency.

Skills

Python

R

SQL

PowerShell

Problem-solving

Analytical skills

Communication

Education

Degree in Computer Science

Master's Degree in STEM-related field

Ph.D. in STEM-related field

Tools

Azure DevOps

Microsoft Dynamics 365

Power BI

Azure Data Factory

Azure Synapse

Job description

Welcome to Yoush Consulting. Yoush Consulting provides project management and information technology expertise to help our clients deliver their projects. Our client is looking to hire a Manager in Data Engineering and we are helping them find an excellent candidate.

Position: Azure DevOps Engineer with D365 and F&O experience

As a Data Engineer, you will be responsible for building and maintaining the systems and processes that allow for the extraction, transformation, and loading (ETL) of data from various sources into our Azure-based data ecosystem.

Responsibilities

• Provide a detailed review and assessment of the enterprise data warehouse environment and proposed changes and implementation plan to improve scalability and performance.
• Design and develop SSIS ETL processes using table partitioning with a focus on performance improvement of large tables.
• Perform data analysis and provide suggestions and feedback to the team to design and develop optimized SQL Queries and Stored Procedures (SCD Type1, SCD Type2 using Hash bytes) to improve performance.
• Design and implement an operational process to provide a high-level summary of SQL Server and database environment to assist in the upgrade and migration of SQL Server databases to newer versions.

Requirements

• 5+ years' experience in leading a high-performance technical team.
• 5+ years of progressive Data Engineering experience in Python, R, SQL, and PowerShell scripting.
• Mandatory experience with Azure Synapse and DW technologies, Microsoft Data Technologies (Azure Data Factory, PowerBI, etc.).
• Experience with Azure (app services, API management, security features).
• Experience in organizing and conditioning data and conducting big data analysis.
• Excellent written and verbal communication skills: ability to clearly communicate with business and technical stakeholders.
• Strong problem-solving and analytical abilities, creativity, and insight with the ability to address complex situations with stakeholders.
• Knowledge of machine learning is a strong asset.
• Knowledge and some experience in data science, predictive modeling is a strong asset.

Application Experience

Experience with applications such as Azure DevOps, Microsoft Dynamics 365, iFirm, Workday, Power BI, and Systems Integration.

Education

Degree in Computer Science, Math, Statistics or STEM-related field. A Master's Degree and/or Ph.D. is a strong asset, but not required.