Senior Data Engineer

Open Systems Technologies; Mississauga; On-site; CAD 110,000 - 130,000; Full time

Job summary

A leading technology firm in Mississauga is seeking a Data Engineer with at least 8 years of experience in designing and implementing large-scale data solutions on Azure Snowflake. The candidate should possess strong skills in data ingestion and transformation using Python and Data bricks. This contract role promises competitive pay between CA$110,000 - CA$130,000.

Qualifications

• Minimum 8 years of experience in large-scale data solution on Microsoft Azure Snowflake.
• Hands-on experience with data ingestion and processing pipelines using Python and Data bricks.
• Excellent understanding of Snowflake Internals and data processing integration.

Responsibilities

• Develop scripts in UNIX, Python to extract, load, and transform data.
• Provide production support for Data Warehouse issues.
• Translate mapping specifications to data transformation strategies.

Skills

Snowflake features

Data warehousing

MS Azure

EL pipelines

Python

Data bricks

Tools

Python

Snow SQL

Job description

• Hands-on development experience with Snowflake features such as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel; Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; and stored procedures.
• Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
• Need to have working knowledge of MS Azure configuration items with respect to Snowflake.
• Developing EL pipelines in and out of data warehouse using combination of Data bricks, Python and Snow SQL.
• Strong understanding or Snowflake on Azure Architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse.
• Developing scripts UNIX, Python etc. to Extract, Load and Transform data, as well as other utility functions.
• Provide production support for Data Warehouse issues such data load problems, transformation translation problems
• Translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.
• Understanding data pipelines and modern ways of automating data pipeline using cloud based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions.
• Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Requirements :

• Minimum 8 years of designing and implementing an operational production grade large-scale data solution on Microsoft Azure Snowflake Data Warehouse.
• Including hands on experience with productionized data ingestion and processing pipelines using Python, Data bricks, Snow SQL
• Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies
• Excellent presentation and communication skills, both written and verbal, ability to problem solve and design in an environment with unclear requirements.

Seniority level

Seniority level

Mid-Senior level

Employment type

Employment type

Contract

Job function

Job function

Information Technology

Banking, Financial Services, and Capital Markets

Referrals increase your chances of interviewing at Open Systems Technologies by 2x

Sign in to set job alerts for “Data Engineer” roles.

Mississauga, Ontario, Canada CA$110,000.00-CA$130,000.00 2 weeks ago

Software Engineer, Backend (All Levels / All Teams)

Graduate 2025 Software Engineer I, Canada

Toronto, Ontario, Canada CA$120,000.00-CA$190,000.00 1 month ago

Software Engineer I, Entry Level (Fall 2024-Spring 2025) - Toronto

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

J-18808-Ljbffr

Create a job alert for this search

Senior Data Engineer • Mississauga, Peel Region, Canada