PySpark Data Engineer — Databricks & Medallion Architecture

Electric Mind Inc.; Toronto; On-site; CAD 100,000 - 140,000; Full time

Job summary

Electric Mind Inc. is seeking a data engineer to build and maintain data pipelines on Databricks for a financial services data platform.

You will join a senior engineer, write PySpark transforms, and ensure healthy pipelines across dev/qa/uat in a medallion architecture (bronze/silver/gold). This is a growth-focused role for someone with strong Python and SQL, eager to learn Spark, and comfortable with code reviews, GitLab, and documenting changes.

Qualifications

• Solid Python fundamentals with ability to write transform code.
• Experience with Databricks and PySpark or strong SQL skills.
• Experience debugging pipelines and reading stack traces.
• Familiar with Git workflow and code reviews.

Responsibilities

• Write and maintain PySpark transforms for bronze/silver/gold data.
• Work with Lakeflow Declarative Pipelines and CDC/SCD patterns.
• Query data in Unity Catalog across environments using SQL warehouses.
• Debug failed pipeline runs and fix schema/data quality issues.
• Maintain reference tables and small utility scripts (PowerShell/Python).
• Write unit/integration tests for transforms.
• Participate in code reviews using GitLab.
• Keep documentation up-to-date when changing how something works.

Skills

Python

Databricks

Spark/PySpark

SQL

Git

Debugging

Tools

GitLab CI

Azure Databricks

Delta Lake

Kafka

Job description

Electric Mind Inc. is seeking a data engineer to build and maintain data pipelines on Databricks for a financial services data platform.

You will join a senior engineer, write PySpark transforms, and ensure healthy pipelines across dev/qa/uat in a medallion architecture (bronze/silver/gold). This is a growth-focused role for someone with strong Python and SQL, eager to learn Spark, and comfortable with code reviews, GitLab, and documenting changes.