Data Engineer

Virtusa; Mississauga; Hybrid; CAD 80,000 - 120,000; Full time

Job summary

A leading technology company is seeking an experienced IT professional specializing in the data warehouse domain. The role involves leveraging SQL and Python to drive data quality, governance, and performance tuning of database queries. Candidates should possess extensive experience in various data management techniques and be familiar with AWS and relevant tools.

Qualifications

• 7+ years experience in IT and data warehouse domain.
• Strong SQL skills with experience in complex queries.
• Exposure to scripting languages such as Python and shell scripting.

Responsibilities

• Performance tuning of database queries and understanding of query optimization.
• Data modeling using dimensional modeling tools.
• Ensuring data quality and governance.

Skills

SQL

Python

Data Governance

Data Quality

DataOps

Tools

Pyspark

AWS

Hive

Impala

Job description

Position Requirements:

7Plus years of experience in IT and data base data warehouse domain, Pyspark Python
Experience in writing sqls in Hive, Impala
Exposure to scripting language like shell scripting, python is required.
Strong SQL skills are essential; experience writing complex queries spanning multiple tables is required.
Experience in AWS is plus.
Working knowledge of performance tuning of database queries (understanding the inner working of the query optimizer, query plans, indexes, partitions etc.).
Working knowledge of data modelling and dimensional modelling tools and techniques.
Experience in data quality, data governance, DataOps and latest data management techniques a bonus.