Lead Databricks Lakehouse Architect

Quebec Solution Inc; United States; On-site; USD 140,000 - 220,000; Full time

Job summary

Quebec Solution Inc. seeks an experienced Databricks Data Architect to design and implement enterprise-scale Lakehouse and real-time data platforms. You will own end-to-end architecture, define technical standards, and optimize Databricks workloads for performance and cost.

Responsibilities include building Bronze, Silver, Gold medallion pipelines, real-time streaming with Kafka, and governance with Unity Catalog, while mentoring engineers and aligning with business goals.

Qualifications

• Proven experience designing enterprise Lakehouse architectures.
• Hands-on mastery of Databricks stack and streaming pipelines.
• Experience with governance, RBAC/ABAC, and security controls.

Responsibilities

• Design and own enterprise Databricks Lakehouse architectures.
• Implement Bronze-Silver-Gold Medallion Architecture.
• Architect batch and real-time data ingestion and processing.
• Build scalable pipelines with Databricks, PySpark, Spark SQL, Delta Lake.
• Develop real-time streaming using Structured Streaming and Kafka.
• Define and implement data governance using Unity Catalog.
• Optimize workloads for performance and cloud costs.
• Lead CI/CD for notebooks, jobs, pipelines, and infra.

Skills

Databricks

PySpark

Python

SQL

Unity Catalog

Auto Loader

Structured Streaming

Medallion Architecture

AWS

S3

AWS Glue

Redshift

IAM

CI/CD

Terraform/CloudFormation

Job description

Quebec Solution Inc. seeks an experienced Databricks Data Architect to design and implement enterprise-scale Lakehouse and real-time data platforms. You will own end-to-end architecture, define technical standards, and optimize Databricks workloads for performance and cost.

Responsibilities include building Bronze, Silver, Gold medallion pipelines, real-time streaming with Kafka, and governance with Unity Catalog, while mentoring engineers and aligning with business goals.