Senior Databricks Architect: Lakehouse Scale & Governance

KData AI; Toronto; On-site; CAD 130,000 - 180,000; Full time

Job summary

KData AI is hiring a Senior Databricks Engineer to own end-to-end lakehouse architectures and data pipelines. You will architect, implement, and optimize batch and streaming workloads on the Databricks platform, ensuring governance, security, and cost efficiency across multi-region environments.

You will mentor engineers, collaborate with analytics and ML teams, and drive platform-wide performance tuning and automated deployment strategies using IaC and CI/CD.

Qualifications

• 8+ years of software/data engineering experience with production-grade systems.
• Deep technical expertise in the Databricks platform and lakehouse architectures.
• Experience with governance, security, and data lineage concepts.

Responsibilities

• Lead lakehouse architecture design using Bronze-Silver-Gold patterns.
• Develop and orchestrate batch and streaming pipelines with PySpark, Spark SQL, and Delta Lake.
• Tune performance and drive FinOps through cost optimization of DBU usage.

Skills

Python (PySpark)

Advanced SQL

Structured Streaming

Tools

Databricks platform

Delta Lake

Terraform

Git

dbt-databricks

Apache Kafka

Power BI

Job description

KData AI is hiring a Senior Databricks Engineer to own end-to-end lakehouse architectures and data pipelines. You will architect, implement, and optimize batch and streaming workloads on the Databricks platform, ensuring governance, security, and cost efficiency across multi-region environments.

You will mentor engineers, collaborate with analytics and ML teams, and drive platform-wide performance tuning and automated deployment strategies using IaC and CI/CD.