Databricks Architect

TechDoQuest; Toronto; On-site; CAD 100,000 - 130,000; Full time

Job summary

A leading technology company in Ontario is seeking an experienced Data Architect to design and architect enterprise-scale data platforms. The ideal candidate will have over 8 years of experience in data engineering, strong proficiency with Databricks and Apache Spark, and a solid understanding of cloud architectures. This role involves leading data modernization initiatives, collaborating with various stakeholders, and providing technical leadership. If you have strong communication skills and the ability to troubleshoot data platform issues, we want to hear from you.

Qualifications

• 8+ years of experience in data engineering or data architecture.
• Strong hands-on experience with Databricks on cloud platforms.
• Expertise in Apache Spark, PySpark, SQL, and data processing.

Responsibilities

• Design and architect enterprise-scale data platforms.
• Lead data modernization initiatives and cloud migrations.
• Provide architectural guidance and technical leadership.

Skills

Data engineering / data architecture / analytics platforms

Databricks

Apache Spark

PySpark

SQL

Cloud architecture

Data governance

Stakeholder management

Tools

Databricks Lakehouse

Delta Lake

Cloud platforms (Azure, AWS, GCP)

Job description

• Design and architect enterprise-scale data platforms using Databricks Lakehouse architecture.
• Lead data modernization initiatives including migration from legacy data warehouses to cloud-based platforms.
• Define best practices for data ingestion, transformation, storage, and analytics using Databricks.
• Implement and optimize Apache Spark, Delta Lake, and Unity Catalog.
• Ensure data security, governance, metadata management, and compliance standards are met.
• Collaborate with cloud, data engineering, analytics, and business stakeholders to translate requirements into technical solutions.
• Provide architectural guidance, code reviews, and technical leadership to delivery teams.
• Support CI/CD pipelines, automation, and infrastructure-as-code for data platforms.
• Troubleshoot performance, scalability, and cost optimization issues.

Required Skills & Qualifications

• 8+ years of experience in data engineering / data architecture / analytics platforms.
• Strong hands-on experience with Databricks on Azure, AWS, or GCP.
• Expertise in Apache Spark, PySpark, SQL, and data processing frameworks.
• Experience with Delta Lake, data lakes, and data warehousing concepts.
• Strong understanding of cloud architecture, networking, and security principles.
• Knowledge of data governance, data quality, lineage, and compliance frameworks.
• Excellent communication and stakeholder management skills.