Databricks Lakehouse Architect & Strategic Advisor

BuzzClan; Dallas (TX); On-site; USD 180,000 - 240,000; Full time

Job summary

BuzzClan is seeking a highly experienced Databricks Subject Matter Expert at Lead/Principal level to serve as the firm’s technical authority on the Databricks Lakehouse Platform. You will guide clients through architecture to production deployment, partnering with CTOs and VPs to define data strategies and mentor delivery teams.

You will lead end-to-end design of Databricks Lakehouse architectures, establish best practices, and oversee large-scale ETL/ELT pipelines across cloud platforms, while

Qualifications

• 10+ years of professional experience in data engineering, analytics, or platform architecture.
• 5+ years of deep, hands on experience with Databricks, including production deployments at enterprise scale.
• Expert level proficiency in Apache Spark (PySpark and/or Scala), Delta Lake, and SQL.
• Proven track record designing multi cloud Lakehouse architectures (Azure, AWS, or GCP).

Responsibilities

• Lead end-to-end design of Databricks Lakehouse architectures, including Delta Lake, Unity Catalog, and medallion data models.
• Define reference architectures, best practices, and reusable accelerators for client engagements.
• Evaluate deployment patterns across Azure Databricks, AWS Databricks, and GCP, aligning with client needs.
• Architect and oversee large-scale ETL/ELT pipelines using Spark, Delta Live Tables, and Workflows.
• Design real-time and batch ingestion frameworks for multiple data sources.
• Establish data quality, lineage, and observability standards using Unity Catalog and Delta Lake features.
• Guide on implementing end-to-end ML workflows using MLflow, Feature Store, and Model Serving.
• Advise on MLOps patterns including model versioning, A/B testing, monitoring, and retraining pipelines.
• Collaborate with data science teams to productionize models and integrate ML outputs into business applications.

Skills

Databricks platform

Apache Spark

SQL

Multi-cloud architecture

Client advisory

Education

Bachelor's degree in CS/Engineering/Data Science

Tools

Unity Catalog

Delta Lake

Delta Live Tables

Databricks Workflows

MLflow

dbt

Terraform/Pulumi

Photon engine

Job description

BuzzClan is seeking a highly experienced Databricks Subject Matter Expert at Lead/Principal level to serve as the firm’s technical authority on the Databricks Lakehouse Platform. You will guide clients through architecture to production deployment, partnering with CTOs and VPs to define data strategies and mentor delivery teams.

You will lead end-to-end design of Databricks Lakehouse architectures, establish best practices, and oversee large-scale ETL/ELT pipelines across cloud platforms, while