Senior Data Engineer: Spark, Databricks & Enterprise DW

E IT; Toronto; On-site; CAD 110,000 - 140,000; Full time

Job summary

E IT in Toronto seeks a Senior Data Engineer with extensive Python, PySpark, SQL and data warehousing experience to support enterprise-level systems and collaborate with business users and analysts.

You will build and optimize data pipelines, design Delta Lake-based DW, implement governance, and lead cloud data platform migrations, delivering scalable analytics for complex data environments.

Qualifications

• 5+ years of SQL Server development for large datasets.
• 5+ years experience developing and deploying ETL pipelines with Databricks PySpark.
• Experience with cloud data warehouses (Synapse, BigQuery, Redshift, Snowflake).
• Experience in data warehousing concepts (OLTP/OLAP, dimensions, facts, modeling).

Responsibilities

• Build and optimize data pipelines for ingestion, transformation and loading with quality.
• Design, develop, and deploy Spark programs in Databricks to process large data volumes.
• Experience with Delta Lake, DWH, data integration, cloud adoption and data modeling.
• Proficient in Python and SQL development including stored procedures.
• Lead enterprise data platform migration with strong architectural and design skills.
• Implement data management, security, and governance within Databricks.

Skills

SQL Server

Databricks PySpark

Cloud data warehouses

Dimensional modeling

Cloud data platform migration

Education

Bachelor's degree in engineering or computer science

Tools

Delta Lake

Spark

Databricks

Job description

E IT in Toronto seeks a Senior Data Engineer with extensive Python, PySpark, SQL and data warehousing experience to support enterprise-level systems and collaborate with business users and analysts.

You will build and optimize data pipelines, design Delta Lake-based DW, implement governance, and lead cloud data platform migrations, delivering scalable analytics for complex data environments.