Senior DataOps/Cloud Data Engineer - Toronto

Randstad Canada; Toronto; On-site; CAD 120,000 - 170,000; Full time

Benefits offered by this job

Onsite 5 days/week

Databricks & DLT access

CI/CD automation

Job summary

Randstad Canada seeks a Senior DataOps/Cloud Data Engineer to design and optimize enterprise data pipelines and unified data platforms in a 5‑day onsite Toronto role. Lead ETL/ELT development, data lakehouse architecture with Unity Catalog, and cross‑platform migrations from legacy Oracle/SQL Server to Azure Databricks.

Collaborate in an Agile environment with strong DataOps and CI/CD ownership. The position focuses on designing automated pipelines, governance, performance tuning, and secure

Qualifications

• Experience designing, building, and optimizing ETL/ELT with Databricks, DLT and PySpark.
• Unified data platforms using Unity Catalog and governance.
• Relational databases and advanced SQL (Oracle, MySQL, SQL Server) and query tuning.
• Azure Data Factory pipelines and CI/CD with Azure DevOps Git integration.
• Cross‑platform data migration from Oracle/SQL Server to Azure/Databricks/Microsoft Fabric.

Responsibilities

• Design, build, automate, and optimize complex ETL/ELT processes using Databricks, DLT, and PySpark.
• Develop and manage unified data lakehouse platforms with governance and lineage.
• Execute large-scale data migrations and integrations from on-prem to cloud destinations.
• Create and orchestrate Azure Data Factory pipelines and Databricks workflows with CI/CD.
• Model relational data and optimize queries across cloud and on-premise databases.
• Implement DataOps practices, monitoring, and documentation in Agile delivery.
• Collaborate with architects and stakeholders to document data flows and procedures.

Skills

Databricks Mastery

Unified Data Governance

Advanced SQL

Azure DevOps CI/CD

Cross-platform Data Migration

Tools

Databricks

Delta Live Tables

Unity Catalog

Azure Data Factory

Azure DevOps

PySpark

Job description

We are seeking an experienced Senior DataOps/Cloud Data Engineer to design, build, automate, and optimize enterprise-grade data pipelines and unified data platforms. In this role, you will lead the end-to-end development of ETL/ELT processes, modern Medallion architecture data lakehouses, and cross-platform data migrations using Databricks, Delta Live Tables (DLT), PySpark, and Azure Data Factory. Working closely with cross-functional technical teams in an Agile environment, you will implement DataOps practices, build CI/CD automation pipelines in Azure DevOps, execute database performance tuning, and establish secure data governance using Unity Catalog.

Location: Toronto, ON (Fully Onsite – 5 days/week required)

Duration: 6-month contract.

Advantages

• Next-Gen Cloud Stack: Direct engineering with Databricks, Delta Live Tables, PySpark, Unity Catalog, and Microsoft Fabric.
• Large-Scale Data Migration: Lead high-visibility enterprise data transformations and cross-platform migrations from legacy Oracle to Azure Cloud environments.
• Automated DataOps & CI/CD: Hands-on ownership of automated pipeline creation, Git integrations, and continuous deployment workflows.
• Dedicated Onsite Synergy: Collaborate directly alongside senior data leads, architects, and engineers in a focused 5-day per week Toronto workspace.

Responsibilities

• ETL/ELT Engineering & Orchestration: Design, build, automate, and optimize complex data extraction, transformation, and loading (ETL/ELT) processes using Databricks, Delta Live Tables (DLT), and PySpark.
• Unified Data Platform Architecture: Develop and manage unified enterprise data lakehouse platforms utilizing Databricks and Unity Catalog for governance, data security, and lineage.
• Data Migration & Integration: Execute large-scale cross-platform data migrations and integrations, moving Very Large Datasets (VLD) from legacy relational systems (Oracle, SQL Server) to cloud destinations (Azure Data Lake, Databricks, Microsoft Fabric).
• Cloud Pipeline Automation & CI/CD: Create, configure, and orchestrate Azure Data Factory copy pipelines and custom Databricks workflows with integrated Azure DevOps Git CI/CD deployment pipelines.
• Database & Dimensional Modeling: Perform relational and dimensional data modeling (fact/dimension tables), schema design, advanced SQL querying (PL/SQL, T-SQL), and query optimization across cloud and on-premise relational databases.
• DataOps & Performance Monitoring: Implement DataOps principles, continuous integration, automated data provisioning, performance monitoring, and query tuning to ensure high availability and scalability.
• Technical Documentation & Collaboration: Partner with architects, developers, and business stakeholders to document technical designs, data flows, and operational procedures in an Agile delivery framework.

Qualifications

• ETL/ELT & Databricks Mastery: Proven experience designing, building, automating, and optimizing complex ETL/ELT processes using Databricks, Delta Live Tables (DLT), and PySpark (Strictly Required).
• Unified Data Governance: Demonstrated experience building unified data platforms using Databricks and Unity Catalog (Strictly Required).
• Database & Advanced SQL Expertise: Strong background with relational databases (Oracle, MySQL, SQL Server), dimensional data modeling, and advanced SQL (PL/SQL, T-SQL) query tuning (Strictly Required).
• Azure Pipeline & CI/CD Engineering: Proficient in creating Azure Data Factory pipelines and custom Databricks pipelines with Azure DevOps Git CI/CD integration (Strictly Required).
• Enterprise Data Migration: Proven experience conducting data migration and integration across platforms (Oracle to Azure Data Lake, Databricks, or Microsoft Fabric) (Strictly Required).

Nice-to-Have Assets

• Experience designing Medallion architecture data lakehouses (Bronze, Silver, Gold layers).
• Proficiency with scripting languages (Python, Unix shell, Scala) and cloud platforms (Azure, AWS, GCP).
• Experience with disaster recovery, failover handling, and troubleshooting large-scale OLAP/OLTP systems.

Summary

Only qualified candidates will be contacted for the next steps.

Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.

Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to [e-mail] to ensure their ability to fully participate in the interview process.

This posting is for existing and upcoming vacancies.