Data Engineer

AIT Global, Inc.; Montreal; On-site; CAD 80,000 - 100,000; Full time

Job summary

A technology company is seeking a Data Engineer in Montreal to translate business requirements into queries, design databases, and develop ETL processes. The ideal candidate should have strong skills in relational databases, Python, and experience with tools like DB2, SQL Server, and Kafka. This role offers a chance to work in a skilled global team focused on database design and big data solutions.

Qualifications

• Strong relational database skills especially with DB2/Sybase/SQL Server or/and Postgres/Greenplum.
• Experience with Power Designer or some similar modeling tool.
• Strong knowledge base of relational database performance and tuning.

Responsibilities

• Translate business requirement into queries and produce reports.
• Design and build scalable and performant databases.
• Build efficient automation scripts.
• Develop databases and ETL, including stored procedures and performance tuning.

Skills

Relational database skills

Python

ETL tools

Effective communication skills

Experience with Agile development process

Tools

DB2

SQL Server

Postgres

Kafka

MongoDB

Spark

Snowflake

Databricks

Power Designer

Unix

Job description

Job Title: Data Engineer
Location: Montreal, QC

Primary Responsibilities

• Translate business requirement into queries against a set of relational tables and produce reporting based on the requirements.
• Design and build scalable and performant databases.
• Database and ETL development, including stored procedures, queries, performance tuning, archiving, etc; using python, SQL and ETL tools.
• Build efficient automation scripts (using Python etc.).
• The current global team members are all very skilled in domain modeling, database design (both relational and noSQL), big data, kafka, and messaging so this is an excellent opportunity to play a key role in the growing team.

Technical Skills Requirement

• Strong relational database skills especially with DB2/Sybase/SQL Server or/and Postgres/Greenplum.
• Kafka and MongoDB knowledge is a plus. However, willing to train.
• Knowledge of Spark, Snowflake, and Databricks is desirable.
• Create high quality and optimized stored procedures and queries.
• Experience with Power Designer or some similar modeling tool.
• Python and Unix / K-Shell.
• Strong knowledge base of relational database performance and tuning such as: proper use of indices, database statistics/reorgs, de-normalization concepts.
• Familiar with lifecycle of a trade and flows of data in an investment banking operation.
• Experienced in Agile development process.
• Effective communication skills.