Data Engineer: PySpark & Databricks (Junior-Mid)

Electricmind; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

Electric Mind is seeking a developer to build and maintain data pipelines on Databricks for a financial services data platform. You’ll transform data with PySpark, publish curated data via file exports and Kafka, and help keep the environment healthy across dev/qa/uat.

The role emphasizes solid Python fundamentals, Spark/SQL exposure, and a learning path toward data engineering specialization. Collaboration with a senior engineer is expected.

Qualifications

• Solid Python fundamentals and basic Spark/SQL exposure.
• Familiarity with Git workflows and code reviews.
• Willingness to learn Databricks internals and grow as a data engineer.

Responsibilities

• Write and maintain PySpark transforms for bronze/silver/gold data models.
• Work with pipeline frameworks (Databricks/DF) and CDC/SCD changes.
• Query and validate data in Unity Catalog across dev/qa/uat.
• Debug failed pipelines by tracing logs and fixing schema drift or data issues.
• Maintain reference data and small utility scripts (PowerShell/Python).
• Write and update unit/integration tests for transforms.

Skills

Python

PySpark

SQL

Git

Debugging

Unit tests

Tools

Databricks

Delta Lake

Medallion architecture

CDC/SCD concepts

Azure Databricks

Kafka

Job description

Electric Mind is seeking a developer to build and maintain data pipelines on Databricks for a financial services data platform. You’ll transform data with PySpark, publish curated data via file exports and Kafka, and help keep the environment healthy across dev/qa/uat.

The role emphasizes solid Python fundamentals, Spark/SQL exposure, and a learning path toward data engineering specialization. Collaboration with a senior engineer is expected.