Senior ETL Engineer – Databricks, Delta Lake, Hybrid

Rubicon Path; Toronto; Hybrid; CAD 90,000 - 120,000; Full time

Job summary

A leading technology firm in Toronto seeks a Software Developer - ETL to design and implement ETL processes using Azure Databricks. This role involves optimizing data flow for analytics and data lakes. Candidates should have 7+ years of ETL experience, proficiency in Python and SQL, and familiarity with Delta Lake and Change Data Capture tools. This position requires at least 3 days per week at the office as part of a hybrid work arrangement.

Qualifications

• 7+ years using ETL tools like Microsoft SSIS and T-SQL.
• 2+ years of experience with Delta Lake and Azure Databricks.
• Solid understanding of Medallion Architecture.

Responsibilities

• Design, develop, and maintain ETL processes in Databricks.
• Work with business teams for efficient data handling.
• Implement error-catching and logging in data pipelines.

Skills

ETL tools (Microsoft SSIS, T-SQL)

Python

PySpark

Delta Lake

SQL

Change Data Capture tools (e.g., GoldenGate)

Education

Databricks Certified Professional Data Engineer

AWS Certified Data Analytics - Specialty

Google Cloud Professional Data Engineer

Tools

Azure Databricks

SQL Server

Oracle

Job description

A leading technology firm in Toronto seeks a Software Developer - ETL to design and implement ETL processes using Azure Databricks. This role involves optimizing data flow for analytics and data lakes. Candidates should have 7+ years of ETL experience, proficiency in Python and SQL, and familiarity with Delta Lake and Change Data Capture tools. This position requires at least 3 days per week at the office as part of a hybrid work arrangement.