Senior Databricks Architect

Lumenalta; Toronto; On-site; CAD 153,000 - 245,000; Full time

Job summary

Lumenalta is seeking a skilled Data Architect to join their team in Toronto. The ideal candidate will have extensive experience in data engineering, particularly with Databricks, and will be responsible for architecting data pipelines and solutions. This role offers the opportunity to work on high-impact projects that drive innovation and real-time analytics.

Benefits

Competitive compensation

Flexibility

Opportunity to shape meaningful solutions

Qualifications

• 6+ years of experience in data engineering/architecture, including 3+ years with Databricks.
• Deep understanding of Databricks features and architecture.
• Strong cloud knowledge—AWS is your home base.

Responsibilities

• Architect end-to-end pipelines using PySpark, SQL, DLT, and dbt.
• Design governed lakehouse solutions using Unity Catalog and Delta Lake.
• Automate infrastructure using Terraform and Databricks CLI.

Skills

Data Engineering

Databricks

PySpark

SQL

Cloud Knowledge

Infrastructure Automation

CI/CD

Data Governance

Job description

3 days ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

At Lumenalta, we create impactful software solutions that drive innovation and transform businesses. Since 2000, we’ve partnered with visionary leaders to build cutting-edge tech, solve complex challenges, and deliver results faster through our elite teams and tech-driven approach. Join us in shaping the future of technology.

What you’ll do

• Architect end-to-end pipelines using PySpark, SQL, DLT, and dbt for batch and streaming use cases.
• Design governed lakehouse solutions using Unity Catalog, Delta Lake, and scalable architecture best practices.
• Leverage cutting-edge Databricks features including:
• Unity Catalog for access control and lineage
• Liquid Clustering for performance tuning
• System Tables for monitoring and cost insights
• Serverless Compute for elastic scalability
• Query Federation and Delta Sharing for unified access
• Automate everything: Use Terraform, Databricks CLI, and REST APIs to provision and manage infrastructure.
• Streamline CI/CD: Build pipelines for notebooks, workflows, DLT, and ML models using GitHub Actions, Jenkins, or Azure DevOps.
• Collaborate cross-functionally: Translate complex business needs into simple, scalable data architecture.
• Champion governance and security: Enforce fine-grained access, logging, and compliance using Unity Catalog and platform controls.
• Stay ahead of the curve: Explore and guide adoption of new Databricks features like Lakehouse Federation, GenAI integrations, and Model Serving.
• Mentor and uplift: Share knowledge, contribute to internal standards, and help raise the bar for data engineering across the team.

What you bring

• 6+ years of experience in data engineering/architecture, including 3+ years hands-on with Databricks in production.
• Deep understanding of Databricks features and architecture, especially: Unity Catalog, Delta Live Tables, Liquid Clustering, Serverless Compute, Photon Engine, System Tables, Query Federation and Delta Sharing
• Strong cloud knowledge—AWS is your home base (S3, IAM, Glue, Redshift, Lambda, Athena, ECS/EKS).
• Infrastructure automation experience with Terraform, CLI tools, and REST APIs.
• CI/CD pro with GitHub Actions, Jenkins, Azure DevOps, or similar.
• Fluency in PySpark, SQL, and Python; experience with dbt, MLflow, Spark internals a plus.
• Practical knowledge of data governance, lineage, access controls, and compliance in cloud-native environments.
• Clear communicator with strong architectural instincts and attention to detail.

Nice to have

• Databricks certifications (Data Engineer Pro, Machine Learning Pro, Lakehouse Architect)
• Experience with Model Serving, Feature Store, Vector Search, or GenAI use cases
• Comfort integrating with BI tools like Tableau, Power BI, and Databricks SQL
• Past work on migrations from Hadoop, Teradata, Informatica, or similar
• Exposure to Databricks on Azure or GCP
• Familiarity with data observability tools
• You’ll work on high-impact projects that power real-time analytics, AI, and innovation at scale.
• You’ll be surrounded by smart, supportive people who care about doing great work and helping each other grow.
• You’ll stay on the forefront of Databricks capabilities and cloud-native design patterns.
• We offer competitive compensation, flexibility, and the chance to shape meaningful solutions for forward-thinking clients.

What's it like to work at Lumenalta?

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering, Information Technology, and Consulting

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Lumenalta by 2x

Get notified about new Architect jobs in Toronto, Ontario, Canada.

Architecture & Engineering Expertise Sought for AI Training

RevOps Architect (Remote, US, Canada or LATAM)

Senior Solution Architect - Data Focus, GTM

D365 CE Solution Architect (Sales, Marketing, Customer Service) - Managed Services

Toronto, Ontario, Canada $153,000.00-$244,700.00 19 hours ago

Senior Solution Architect, BizApps Focused, Delivery GTM

Toronto, Ontario, Canada CA$170,000.00-CA$190,000.00 1 month ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.