Senior ETL & Databricks Data Platform Engineer

LanceSoft; Toronto; On-site; CAD 80,000 - 120,000; Full time

Job summary

An established industry player is seeking a Senior ETL Developer/Specialized IT Consultant to join their dynamic team. In this role, you will leverage your extensive experience in developing and managing ETL pipelines, utilizing cutting-edge tools like Databricks and Delta Lake. Your expertise will be crucial in ensuring data quality and optimizing data workflows, while also collaborating with cross-functional teams to communicate complex concepts effectively. This position offers a unique opportunity to work on innovative projects that drive data-driven decision-making, making a significant impact on the organization. If you are passionate about data engineering and eager to contribute to transformative initiatives, this role is perfect for you.

Qualifications

• 7+ years of experience with ETL tools and data management.
• Strong skills in Python and PySpark for data manipulation.
• Expertise in Delta Lake and Databricks for data optimization.

Responsibilities

• Develop and manage ETL pipelines and workflows in Databricks.
• Create design documentation and troubleshoot ETL processes.
• Collaborate with teams and provide technical guidance.

Skills

ETL Development

Delta Lake

Databricks

Python

PySpark

SQL

Data Governance

Change Data Capture (CDC)

Medallion Architecture

Data Quality Assurance

Tools

Microsoft SSIS

Azure Data Factory

Unity Catalog

GoldenGate

SQL Server

Oracle

Job description

An established industry player is seeking a Senior ETL Developer/Specialized IT Consultant to join their dynamic team. In this role, you will leverage your extensive experience in developing and managing ETL pipelines, utilizing cutting-edge tools like Databricks and Delta Lake. Your expertise will be crucial in ensuring data quality and optimizing data workflows, while also collaborating with cross-functional teams to communicate complex concepts effectively. This position offers a unique opportunity to work on innovative projects that drive data-driven decision-making, making a significant impact on the organization. If you are passionate about data engineering and eager to contribute to transformative initiatives, this role is perfect for you.