Senior Data Engineer - Hybrid (AWS Databricks, ML Pipelines)

Hire DigITalent Inc.; Toronto; Hybrid; CAD 120,000 - 150,000; Full time

Job summary

Hire DigITalent Inc. is assisting a client in accelerating its digital transformation with a modern data platform on AWS and a Databricks-based architecture. They seek a seasoned Senior Data Engineer to lead architectural decisions, stabilize deliverables, and guide strategy on a high-visibility project.

This six-month contract starts with 3 days in the office in Toronto, Ontario, and offers hands-on leadership, mentorship, and collaboration with data scientists to productionize ML pipelines.

Qualifications

• Proven track record running, building, or enterprise-scaling data platforms in AWS environments.
• Deep expertise in the Databricks ecosystem running natively on AWS (PySpark, Delta Lake, MLflow, Delta Live Tables).
• Practical understanding of dimensional modeling, Medallion architecture, and schema design for analytics.

Responsibilities

• Solve foundational data engineering and Medallion architecture challenges on AWS Databricks, building a robust ingestion framework for diverse, high-volume datasets.
• Apply practical data modeling principles to streamline data layer creation and organize collection/transaction data for analytics.
• Standardize, productionize, and build automated, reusable ML pipelines; partner with Data Scientists to productionize models.
• Cut through complexity and prevent scope creep; establish MVP boundaries and guide task priorities.
• Provide guidance, architectural direction, and hands-on mentorship to internal team members, elevating data engineering standards.
• Use exceptional communication and political acumen to align stakeholders toward cohesive technical decisions.

Skills

AWS data platform

Databricks on AWS

PySpark

Delta Lake

MLflow

Dimensional modeling

Medallion architecture

CI/CD pipelines

Production ML pipelines

Stakeholder alignment

Mentorship

Communication

Job description

Hire DigITalent Inc. is assisting a client in accelerating its digital transformation with a modern data platform on AWS and a Databricks-based architecture. They seek a seasoned Senior Data Engineer to lead architectural decisions, stabilize deliverables, and guide strategy on a high-visibility project.

This six-month contract starts with 3 days in the office in Toronto, Ontario, and offers hands-on leadership, mentorship, and collaboration with data scientists to productionize ML pipelines.