Senior Databricks Data Architect: Lakehouse Leader

Rubicon Path; Toronto; On-site; CAD 120,000 - 150,000; Full time

Job summary

A financial services company in Toronto is seeking a senior Databricks Data Architect to lead a team of data engineers. The role involves building and optimizing a robust data platform, ensuring security and performance for data processing needs. Key responsibilities include implementing Databricks Unity Catalog for data governance, managing cluster configurations in Azure, and collaborating with cross-functional teams to design scalable data solutions. Ideal candidates should have extensive experience in data engineering and strong expertise in Databricks and PySpark.

Qualifications

• 7+ years of experience in data engineering or architecture roles.
• Significant hands-on experience with Databricks (preferably Azure).
• Proficient in building data pipelines using PySpark/Scala.

Responsibilities

• Own the Databricks platform architecture and implementation.
• Implement and manage Databricks Unity Catalog for governance.
• Collaborate with analytics teams to optimize SQL queries.

Skills

Data engineering

Databricks (Azure)

PySpark

Delta Lake

SQL optimization

Data governance

Team leadership

Education

Bachelor's degree in Computer Science, Information Systems

Tools

Databricks Lakehouse

Azure DevOps

Terraform

Apache Spark

Job description

A financial services company in Toronto is seeking a senior Databricks Data Architect to lead a team of data engineers. The role involves building and optimizing a robust data platform, ensuring security and performance for data processing needs. Key responsibilities include implementing Databricks Unity Catalog for data governance, managing cluster configurations in Azure, and collaborating with cross-functional teams to design scalable data solutions. Ideal candidates should have extensive experience in data engineering and strong expertise in Databricks and PySpark.