Manager, Data Engineering

Yoush Consulting; Toronto; On-site; CAD 85,000 - 110,000; Full time

Job summary

A technology consulting firm in Toronto is seeking an Azure DevOps Engineer specialized in Data Engineering. The role involves managing a team, optimizing ETL processes, and leveraging Azure technologies for data projects. Candidates should have 5+ years of relevant experience, strong skills in Python, SQL, and Data Warehousing, along with excellent problem-solving abilities. Familiarity with big data analysis and knowledge of machine learning is a strong asset. This position offers the opportunity to work with cutting-edge technologies in a collaborative environment.

Qualifications

• 5+ years of experience in leading a high-performance technical team.
• Expertise in Python, R, SQL, and PowerShell scripting.
• Mandatory experience with Azure Synapse and Data Warehouse technologies.

Responsibilities

• Manage and assist a team of data engineers.
• Design and develop SSIS ETL processes to improve performance.
• Perform data analysis and provide feedback on SQL queries.

Skills

Data Engineering experience

Python

SQL

R

PowerShell scripting

Azure Synapse

Microsoft Data Technologies

Communication skills

Problem-solving abilities

Education

Degree in Computer Science, Math, Statistics or STEM-related field

Tools

Azure DevOps

Microsoft Dynamics 365

Power BI

Job description

Welcome to Yoush Consulting. Yoush Consulting provides project management and information technology expertise to help our clients deliver their projects. Our client is looking to hire a Manager in data Engineering and we are helping them find an excellent one.

Azure DevOps Engineer with D365 and F&O experience - As a Data Engineer, you will be responsible for building and maintaining the systems and processes that allow for the extraction, transformation, and loading (ETL) of data from various sources into our Azure-based data ecosystem.

Responsibilities: M anage, guide, and assist a team of data engineers to provide:

• Providea detailed review and assessment of the enterprise data warehouse environment and proposed changes and implementation plan to improve scalability and performance
• Design and develop SSIS ETL process using table partitioning with a focus on performance improvement of large tables
• Performdata analysis and provided suggestions and feedback to the team to design and develop optimized SQL Queries and Stored Procedures (SCD Type1, SCD Type2 using Hash bytes) to improve performance
• Design and implement an operational process to provide a high-level summary of SQL Server and database environment to assist in the upgrade and migration of SQL Server databases to newer versions

Requirements

• 5+ years' experience in leading a high-performance technical team

• 5+ years of progressive Data Engineering experience in Python, R, SQL and PowerShell scripting

• Mandatory experience with Azure Synapse and DW technologies, Microsoft Data Technologies (Azure Data Factory, PowerBI, etc.)

• Experience with Azure (app services, API management, security features)

• Experience in organizing and conditioning data and conducting big data analysis

• Excellent written and verbal communication skills: ability to clearly communicate with business and technical stakeholders

• Strong problem-solving and analytical abilities, creativity, and insight with the ability to address complex situations with stakeholders

• Knowledge of machine learning is a strong asset

• Knowledge and some experience in data science, predictive modelling is a strong asset

Application Experience:

• Experience with applications such as Azure DevOps, Microsoft Dynamics 365, iFirm, Workday, Power BI, and Systems Integration

Education:

• Degree in Computer Science, Math, Statistics or STEM-related field. A Masters Degree and/or Ph.D is a strong asset, but not required