Databricks Data Engineering Manager (AWS/AZURE)

Ccube

Mississauga

Hybrid

CAD 150,000 - 190,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Ccube in Mississauga, ON is seeking a Senior Databricks Manager to design and lead scalable, secure data platforms on AWS and/or Azure. You will guide data engineers, drive architecture, and ensure delivery of high-performance pipelines in a hybrid work model.

The role demands 10+ years in data engineering with leadership experience, strong Databricks/Spark skills, and expertise in data lakes, medallion architectures, and CI/CD practices. Collaboration with stakeholders is essential for success.

Qualifications

  • 10+ years in Data Engineering with 2–4 years in a Data Engineering Manager / Technical Lead / Engineering Lead role.
  • Hands-on experience with Databricks and Apache Spark.
  • Expertise in AWS and/or Azure cloud data platforms.
  • Strong understanding of Data Lakes, Lakehouses, Data Warehousing and Medallion Architecture.
  • Experience designing and implementing scalable ETL/ELT pipelines and data integration frameworks.
  • Strong proficiency in SQL and Python/PySpark.
  • Experience with Kafka, Airflow, dbt or equivalent orchestration and streaming technologies.
  • Experience with structured, semi-structured and unstructured data.
  • Strong understanding of Data Governance, Security, CI/CD, DevOps and data quality frameworks.
  • Proven experience managing engineering teams, technical delivery and stakeholder expectations.
  • Excellent leadership, communication, problem-solving and people management skills.

Responsibilities

  • Lead Data Engineering teams responsible for building enterprise-scale data platforms using Databricks on AWS and/or Azure.
  • Drive end-to-end delivery of modern data engineering solutions, including Data Lakes, Lakehouses and Data Warehouses.
  • Define and implement scalable data engineering strategies, architecture standards and best practices.
  • Lead the design and implementation of Medallion Architecture (Bronze, Silver and Gold layers).
  • Oversee the development of robust ETL/ELT pipelines, batch processing and real-time streaming solutions.
  • Ensure data platform scalability, reliability, performance optimization and cost efficiency.
  • Drive engineering excellence through code reviews, CI/CD automation, DevOps practices and reusable frameworks.
  • Establish data governance, data quality, security and compliance standards across data platforms.
  • Collaborate with Enterprise Architects, Product Owners, Business Stakeholders and cross-functional teams.
  • Manage project execution, resource allocation, delivery timelines, risks and technical dependencies.
  • Mentor and develop Data Engineers, Senior Engineers and Technical Leads.
  • Drive cloud data modernization initiatives and continuous improvement across engineering processes.

Skills

Databricks
Apache Spark
AWS Cloud
Azure Cloud
SQL
Python/PySpark
Data Governance
Leadership
Data Engineering
CI/CD DevOps

Tools

Kafka
Airflow
dbt
Spark SQL
CI/CD tooling

Job description

We are looking for a Senior Databricks Manager to design and lead scalable, secure, and high-performance cloud data platforms across AWS and/or Azure. "Mississauga, ON (Hybrid - 3 Days Onsite Per Week)."

Job Title: Databricks Data Engineering Manager - (AWS/Azure)

Location: Mississauga, ON (Hybrid - 3 Days Onsite Per Week) Employment Type: Full-Time/CTH

Key Responsibilities
  • Lead and manage Data Engineering teams responsible for building enterprise-scale data platforms using Databricks on AWS and/or Azure.
  • Drive end-to-end delivery of modern data engineering solutions, including Data Lakes, Lakehouses and Data Warehouses.
  • Define and implement scalable data engineering strategies, architecture standards and best practices.
  • Lead the design and implementation of Medallion Architecture (Bronze, Silver and Gold layers).
  • Oversee the development of robust ETL/ELT pipelines, batch processing and real-time streaming solutions.
  • Ensure data platform scalability, reliability, performance optimization and cost efficiency.
  • Drive engineering excellence through code reviews, CI/CD automation, DevOps practices and reusable frameworks.
  • Establish data governance, data quality, security and compliance standards across data platforms.
  • Collaborate with Enterprise Architects, Product Owners, Business Stakeholders and cross-functional teams.
  • Manage project execution, resource allocation, delivery timelines, risks and technical dependencies.
  • Mentor and develop Data Engineers, Senior Engineers and Technical Leads.
  • Drive cloud data modernization initiatives and continuous improvement across engineering processes.
Must-Have Skills
  • 10+ years of experience in Data Engineering, with at least 2-4 years in a Data Engineering Manager / Technical Lead / Engineering Lead role.
  • Strong hands-on experience with Databricks and Apache Spark.
  • Expertise in AWS and/or Azure cloud data platforms.
  • Strong understanding of Data Lakes, Lakehouses, Data Warehousing and Medallion Architecture.
  • Experience designing and implementing scalable ETL/ELT pipelines and data integration frameworks.
  • Strong proficiency in SQL and Python/PySpark.
  • Experience with Kafka, Airflow, dbt or equivalent orchestration and streaming technologies.
  • Experience with structured, semi-structured and unstructured data.
  • Strong understanding of Data Governance, Security, CI/CD, DevOps and data quality frameworks.
  • Proven experience managing engineering teams, technical delivery and stakeholder expectations.
  • Excellent leadership, communication, problem-solving and people management skills.
Good to Have
  • PMP, PMI-ACP, CSM or SAFe certifications.
  • AWS/Azure cloud certifications.
  • Databricks certifications.
  • Snowflake experience.
  • Experience with Data Mesh and enterprise data architecture.
  • Exposure to MLOps, AI/ML data platforms and GenAI data engineering.
  • Experience managing distributed engineering teams and Agile delivery models.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr Data Architect (AWS & Databricks)
Sr Data Architect (AWS & Databricks)

Ccube • Mississauga

Hybrid
CAD 120,000 - 170,000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Raise - find a more meaningful working experience • Toronto

Hybrid
CAD 100,000 - 167,000
Principal Data Engineer – Databricks
Principal Data Engineer – Databricks

Astra-North Infoteck Inc. • Toronto

On-site
CAD 140,000 - 190,000
Senior Databricks Data Platform Engineer (PySpark)
Senior Databricks Data Platform Engineer (PySpark)

Enterprise Solutions Inc. • Montreal

Hybrid
CAD 120,000 - 170,000
Azure Databricks Engineer
Azure Databricks Engineer

Data Elephant • Calgary

On-site
CAD 120,000 - 180,000
Databricks Data Platform Engineer
Databricks Data Platform Engineer

Mindtris • Canada

Remote
CAD 120,000 - 180,000
Databricks Engineer
Databricks Engineer

Compunnel Inc. • Mississauga

On-site
CAD 120,000 - 150,000
Senior Databricks Developer
Senior Databricks Developer

Global Technical Talent • Toronto

Hybrid
CAD 103,000 - 131,000
Hybrid work arrangement
Databricks Architect
Databricks Architect

TechDoQuest • Toronto

On-site
CAD 100,000 - 130,000
Sr. Data Engineer
Sr. Data Engineer

Recruiting in Motion • Toronto

Hybrid
CAD 120,000 - 140,000