Databricks PySpark Engineer: Junior to Mid

Electric Mind Inc.; Toronto; On-site; CAD 70,000 - 110,000; Full time

Job summary

Electric Mind Inc. is seeking a Consultant - PySpark / Databricks Developer (Junior to Intermediate) to build and maintain data pipelines on Databricks for a financial services data platform.

You’ll work with a senior engineer, writing transforms, fixing pipeline issues, and keeping the environment healthy across dev/qa/uat. The role targets someone with solid Python fundamentals and some Spark/SQL exposure who wants to grow into a data engineering specialist.

Qualifications

• Solid Python fundamentals with clean, readable code.
• Some exposure to Apache Spark / PySpark or strong SQL skills with willingness to learn Spark quickly.
• Working knowledge of SQL (joins, aggregations, window functions).
• Basic Git workflow: branches, commits, pull/merge requests.
• Comfortable reading others' code and debugging methodically.

Responsibilities

• Write and maintain PySpark transforms for bronze/silver/gold data models.
• Work with Databricks' pipeline framework and CDC/ SCD concepts.
• Query and validate data in Unity Catalog across environments using SQL warehouses.
• Debug failed pipeline runs and fix schema drift or data quality issues.
• Maintain reference tables and small utility scripts (PowerShell/Python).
• Write unit/integration tests and participate in code reviews.

Skills

Python

Spark/PySpark exposure

SQL

Git workflow

Debugging

Tools

Databricks

Delta Lake

Azure

Kafka

GitLab CI

Job description

Electric Mind Inc. is seeking a Consultant - PySpark / Databricks Developer (Junior to Intermediate) to build and maintain data pipelines on Databricks for a financial services data platform.

You’ll work with a senior engineer, writing transforms, fixing pipeline issues, and keeping the environment healthy across dev/qa/uat. The role targets someone with solid Python fundamentals and some Spark/SQL exposure who wants to grow into a data engineering specialist.