Senior Data Engineer - Databricks Lead (Hybrid, Toronto)

Jarvis Consulting Group; Toronto; Hybrid; CAD 120,000 - 170,000; Full time

Job summary

Jarvis Consulting Group, based in Toronto, leads data, AI and tech engagements across Canada/US. We are seeking a Senior Data Engineer with deep Databricks expertise to act as the Big Data/Cloud technical lead on our latest engagements.

This is a build-and-lead role demanding architecture, hands-on Spark/Databricks work, and mentorship. You will own end-to-end data platforms, build scalable ETL pipelines, and mentor junior engineers while coordinating with clients and teams in a hybrid Toronto

Qualifications

• 5+ years of Spark development (PySpark/Scala) required.
• Databricks expert with certifications strongly preferred.
• Azure services (ADLS, ADF, AKS) experience expected.
• Streaming tech such as Kafka and Spark Streaming beneficial.
• Agile development experience with Jira/Confluence.
• Git and CI/CD tooling familiarity.
• IDEs, Maven/SBT and orchestration tools (Airflow, Cron) knowledge.
• Containerization with Docker/Kubernetes is a strong plus.
• University degree in a STEM discipline.

Responsibilities

• Own Big Data & Cloud environments end-to-end for clients.
• Architect and lead Spark/Databricks development initiatives.
• Build scalable ETL pipelines and data platforms.
• Mentor junior engineers and lead multi-team delivery.
• Define technical requirements and project objectives.
• Ensure code quality with reviews and testing.

Skills

Databricks experience

Spark development

Azure services

Kafka / Spark Streaming

Agile development

Git

IDEs / build tools

Orchestration tools

Docker / Kubernetes

Cloud deployments

Communication

Education

University degree in STEM (CS/CE/SE/Math)

Tools

JIRA

Confluence

Maven

SBT

Airflow

Autosys

Oozie

Job description

Jarvis Consulting Group, based in Toronto, leads data, AI and tech engagements across Canada/US. We are seeking a Senior Data Engineer with deep Databricks expertise to act as the Big Data/Cloud technical lead on our latest engagements.

This is a build-and-lead role demanding architecture, hands-on Spark/Databricks work, and mentorship. You will own end-to-end data platforms, build scalable ETL pipelines, and mentor junior engineers while coordinating with clients and teams in a hybrid Toronto