Data Engineer - Azure/Databricks

2iSolutions Inc.; Oshawa; Hybrid; CAD 80,000 - 100,000; Full time

Job summary

A technology solutions provider is seeking 2 Data Engineers to join their team in Oshawa. The roles are 1-year contracts requiring expertise in Microsoft technologies, particularly Azure and Databricks. Ideal candidates will design and build data pipelines, contributing to customer-centric applications in a hybrid environment. Responsibilities include supporting data lake and warehouse products, collaborating in agile teams, and ensuring effective data governance. This position offers a dynamic work experience and is based in Durham Region.

Qualifications

• Experience as a Data Engineer designing and building data pipelines.
• Fluent in creating data processing frameworks using Python and PySpark.
• Good understanding of data structures and data processing frameworks.

Responsibilities

• Design, build and support data-driven applications.
• Work as part of a cross-discipline agile team.
• Build reliable and performant data lake and warehouse products.

Skills

Data pipeline design

Fluent in Python

Experience with Azure Data Factory

Knowledge of data governance

Tools

Azure Data Factory

Azure Databricks

Power BI

Job description

Our Client in Oshawa is looking to hire 2 Data Engineers with deep experience as a Data Engineer with Microsoft Technologies. These positions are 1 year contract roles - hybrid 2 days/week on-site in Oshawa.

Job Overview

• As an Azure and Databricks Data Engineer, you will be responsible for designing, building and supporting the data driven applications which enable innovative, customer centric digital experiences.
• Will be working as part of a cross-discipline agile team who help each other solve problems across all business areas.
• Will build reliable, supportable & performant data lake & data warehouse products to meet the organization’s need for data to drive reporting analytics, applications, and innovation.
• Work with tools in the Microsoft Stack; Azure Data Factory, Azure Data Lake, Azure SQL Databases, Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BI.

Qualifications

• Experience as a Data Engineer designing and building data pipelines.
• Fluent in creating data processing frameworks using Python, PySpark, SparkSOL and SOLExperience with Azure Data Factory, ADLS, Synapse Analytics and Databricks
• Experience building data pipelines for Data Lakehouses and Data Warehouses
• Good understanding of data structures and data processing frameworks
• Knowledge of data governance and data quality principles

Please reach out to discuss the position further.....