Cloud Data Engineer

Symbiotic Group; Toronto; Hybrid; CAD 120,000 - 180,000; Full time

Benefits offered by this job

Hybrid work arrangement

Job summary

Symbiotic Digital, a division of Symbiotic Group Inc., seeks an experienced Cloud Data Engineer to design, build, optimize, and support enterprise-scale cloud data solutions in Toronto. You will develop end-to-end datapipelines, implement DataOps practices, and enable scalable cloud-based data platforms to support business objectives.

The role requires 8+ years of experience, strong ETL/ELT, Databricks, and SQL skills, plus experience with data migration and modern data architectures.

Qualifications

• Design,build, automate, and optimize complex ETL/ELT processes using Databricks, Delta Live Tables (DLT), or equivalent technologies.
• Development of unified data platforms using Databricks and Unity Catalog or equivalent.
• Strong experience with relational databases including Oracle, MySQL, and SQL Server.
• Expertise in relational and dimensional data modeling.
• Advanced SQL development and query optimization.
• Experience with data replication and database administration.
• Advanced SQL skills including PL/SQL and T-SQL.
• Experience working with Big Data processing frameworks such as PySpark.
• Experience building custom Databricks pipelines integrated with CI/CD processes and Azure DevOps Git Integration.
• Experience with data migration and integration across platforms including: Oracle to Databricks; Oracle to Microsoft Fabric

Responsibilities

• Design and develop data pipelines from source systems through to end-user consumption.
• Optimize and maintain high-performance data pipelines.
• Develop and manage cloud-based data platforms, data storage, and data exchange solutions.
• Build, orchestrate, deploy, and automate data workflows and pipelines.
• Develop integrations across multiple platforms using various programming languages and scripting techniques.
• Apply DataOps principles, best practices, and Agile delivery methodologies.
• Implement CI/CD processes and automation.
• Support data provisioning, data exchange, and data security initiatives.
• Design and implement large-scale data migration and transformation solutions across cloud environments.
• Develop fact/dimension models, enterprise data warehouses, data lakes, and data lakehouse architectures.
• Manage cloud data services including storage repositories, data lakes, lakehouses, key vaults, VMs, and related infrastructure.
• Support structured, semi-structured, and unstructured data ingestion, provisioning, and data exchange processes.
• Monitor, troubleshoot, tune, and optimize DataOps solutions.
• Collaborate with technical and business stakeholders to deliver scalable data solutions.

Skills

ETL/ELT

Databricks

DLT

SQL development

Big Data

PySpark

CI/CD

Azure DevOps

Data migration

Data modeling

Tools

Databricks

Unity Catalog

Azure Data Factory

Job description

Job Description

Location: Toronto, ON

Job ID#: RQ11486

Duration: 6 Months

Role Overview

We are seeking an experienced Cloud Data Engineer to design,build, optimize, and support enterprise-scale cloud data solutions. Thesuccessful candidate will play a key role in developing end-to-end datapipelines, implementing modern DataOps practices, and enabling scalable cloud-baseddata platforms that support business and operational objectives.

This position requires expertise in cloud data engineering,data migration, ETL/ELT development, automation, data warehousing, andlarge-scale data transformation initiatives.

Key Responsibilities

• Designand develop data pipelines from source systems through to end-userconsumption.
  
• Optimizeand maintain high-performance data pipelines.
  
• Developand manage cloud-based data platforms, data storage, and data exchangesolutions.
  
• Build,orchestrate, deploy, and automate data workflows and pipelines.
  
• Developintegrations across multiple platforms using various programming languagesand scripting techniques.
  
• ApplyDataOps principles, best practices, and Agile delivery methodologies.
  
• ImplementContinuous Integration and Continuous Deployment (CI/CD) processes andautomation.
  
• Supportdata provisioning, data exchange, and data security initiatives.
  
• Designand implement large-scale data migration and transformation solutionsacross cloud environments.
  
• Developfact/dimension models, enterprise data warehouses, data lakes, and datalakehouse architectures.
  
• Managecloud data services including storage repositories, data lakes,lakehouses, key vaults, virtual machines, and related infrastructure.
  
• Supportstructured, semi-structured, and unstructured data ingestion,provisioning, and data exchange processes.
  
• Monitor,troubleshoot, tune, and optimize DataOps solutions.
  
• Collaboratewith technical and business stakeholders to deliver scalable datasolutions.
  

Mandatory Skills & Experience (8+ Years)

• Design,build, automate, and optimize complex ETL/ELT processes using Databricks,Delta Live Tables (DLT), or equivalent technologies.
  
• Developmentof unified data platforms using Databricks and Unity Catalog orequivalent.
  
• Strongexperience with relational databases including Oracle, MySQL, and SQLServer.
  
• Expertisein relational and dimensional data modeling.
  
• AdvancedSQL development and query optimization.
  
• Experiencewith data replication and database administration.
  
• AdvancedSQL skills including PL/SQL and T-SQL.
  
• Experienceworking with Big Data processing frameworks such as PySpark.
  
• Experiencebuilding custom Databricks pipelines integrated with CI/CD processes andAzure DevOps Git Integration.
  
• Experiencewith data migration and integration across platforms including:
  
• Oracleto Databricks
  
• Oracleto Microsoft Fabric
  

Desired Skills & Experience

• Datalake and lakehouse architecture design utilizing Medallion Architecture.
  
• Advancedexperience with Oracle databases, Azure SQL Server, and Azure DataFactory.
  
• Experiencewith cloud platforms including Azure, AWS, and Google Cloud Platform(GCP).
  
• Experiencetroubleshooting, performance tuning, failover, recovery, and productionsupport.
  
• Experiencewith Python, Unix Shell Scripting, and Scala.
  

Additional Information

• Hybridwork arrangement.
  
• Candidatesshould be available during standard business hours.
  
• Stronganalytical, problem-solving, communication, and stakeholder managementskills are required.
  
• Provenability to work independently as well as within collaborative projectteams.
  
• Experiencedelivering enterprise data warehouse, data lake, and cloud modernizationinitiatives is highly desirable.
  

About Symbiotic Digital.

Symbiotic Digital provides the IT Experts you need thatsolve problems and get things done. See what the top 2% in their field can dofor you. (Symbiotic Digital is a division of Symbiotic Group Inc.)

We serve customers in two ways, we provide:

• DigitalExperts: IT Consulting expertise. Bright Minds That Produce Proven Results
  
• Recruitment:Find The Right People You Need
  

Serving IT & Business leaders, Symbiotic Digitalprovides a business system that enable us to provide the Expert Technical staffneeded to solve challenging business and IT problems. IT leaders in the mostreputable organizations in Canada have relied on Symbiotic Digital to help themstaff difficult assignments with proven Experts uniquely evaluated by ourproven QMS- Quality Management System Staff Development Model. We are a 100%Indigenous owned company.