Azure Databricks Data Engineering Advisor

Desjardins; Montreal West; On-site; CAD 90,000 - 120,000; Full time

Benefits offered by this job

Annual bonus

4 weeks vacation

Pension plan

Group insurance

Telework equipment

Job summary

Desjardins is seeking a data engineering advisor for the Cybersecurity Monitoring Ecosystem Department to help build and maintain a security data lake, the primary data source for the Information Security Division. You will create ingestion pipelines, API modules for governance, and automated data quality controls.

The role is a 12-month temporary position offering a competitive salary, annual bonus, and comprehensive benefits, with French language proficiency required.

Qualifications

• Bachelor's degree in computer science or a related field
• A minimum of four years of relevant experience with Azure tools: Azure Databricks, FunctionApp, LogicApp, SQL
• Azure Databricks certification or demonstrated equivalent in ETL
• Intermediate or advanced experience in Python, PySpark, Java or C#
• Intermediate or advanced experience in SQL
• Knowledge of French is required
• Knowledge of Storage Account, SQL Server or Databricks

Responsibilities

• Develop scripts and automation to ingest data into the consumption zone and to transform and valorize data for the consumption zone
• Develop API call modules to support data governance and documentation activities
• Develop automated modules to support data quality control activities and appropriate corrective measures

Skills

Azure Databricks

PySpark

Python

Java

C#

SQL

French

Education

Bachelor's degree in computer science or related field

Tools

Azure Databricks

FunctionApp

LogicApp

SQL

Storage Account

SQL Server

Databricks

Job description

Desjardins is seeking a data engineering advisor for the Cybersecurity Monitoring Ecosystem Department to help build and maintain a security data lake, the primary data source for the Information Security Division. You will create ingestion pipelines, API modules for governance, and automated data quality controls.

The role is a 12-month temporary position offering a competitive salary, annual bonus, and comprehensive benefits, with French language proficiency required.