Data Engineer

spruceinfotech; Toronto; Hybrid; CAD 80,000 - 120,000; Full time

Job summary

A leading company in Toronto is seeking a Data Engineer to join their Capital Markets Data AI and Research Technology team. This role involves designing and optimizing data pipelines, deploying Spark workloads, and collaborating with data scientists to drive data-driven decisions. Candidates should have strong experience with Python, Spark, and SQL, as well as familiarity with Databricks and CI/CD practices.

Qualifications

• Strong experience with Python and Spark (PySpark).
• Hands-on with Databricks and SQL for complex data transformations.
• Solid understanding of distributed data processing.

Responsibilities

• Design, build, and optimize scalable data pipelines.
• Deploy and performance-tune large-scale Spark workloads.
• Collaborate with data scientists and business stakeholders.

Skills

Python

Spark

SQL

CI / CD

Data Engineering

Tools

Databricks

Apache Hive

AWS

Snowflake

Airflow

Job description

Toronto location. Hybrid work culture in downtown office.

Note : There will be a coding test round

What is the opportunity

Capital Markets Data AI and Research Technology (DART) team is looking to hire a Data Engineer to build manage and deploy cutting edge Data solutions.

What will you do

Design build and optimize scalable data pipelines to support Research Digitization Banking Global Markets and Data Monetization use cases

Develop and operationalize data products across structured and unstructured sources including alternative data

Deploy manage and performancetune largescale Spark workloads on Databricks ensuring reliability scalability and costefficiency

Collaborate with data scientists quant teams and business stakeholders to enable datadriven decisionmaking

Contribute to automation efforts via CI / CD pipelines infrastructureascode and reusable data frameworks

Must Have

Strong experience with Python and Spark (PySpark)

Handson with Databricks (Jobs Workflows Delta Lake Unity Catalog)

Proficient in SQL for complex data transformations and optimizations

Proficient in CI / CD principles version control and best practices for deploying workloads to production

Solid understanding of distributed data processing and productiongrade data workflows

Nice to Have

Exposure to Machine Learning workflows and tools like MLFlow

Exposure to Generative AI stack (LLMs Agents MCP Servers)

Familiarity with Snowflake Airflow or similar orchestration and warehousing platforms

Remote Work : Employment Type :

Contract

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Experience : years

Vacancy : 1

Create a job alert for this search

Data Engineer • Toronto, Ontario, Canada