Senior Databricks Expert

BuzzClan; Dallas (TX); On-site; USD 140,000 - 190,000; Full time

Job summary

BuzzClan seeks a Lead/Principal Databricks Solution Architect to design and implement enterprise Lakehouse solutions, guide data platform strategy, and mentor teams.

You will architect Delta Lake/Unity Catalog solutions, lead Spark-based ETL pipelines, and advise clients on cloud deployments (Azure/AWS/GCP), governance, and MLOps. The role demands strong client-facing leadership and pre-sales involvement with a track record of production deployments.

Qualifications

• 10+ years in data engineering, analytics, or platform architecture.
• 5+ years of hands-on Databricks experience with enterprise production deployments.
• Bachelor’s degree in a relevant technical field or equivalent experience.

Responsibilities

• Design scalable Databricks Lakehouse architectures using Delta Lake, Unity Catalog, and medallion architecture.
• Lead ETL/ELT pipelines using Apache Spark, PySpark/Scala, and Databricks Workflows.
• Guide cloud deployments across Azure, AWS, or GCP.
• Establish data governance, quality, lineage, and observability standards.
• Support MLflow, MLOps, and production machine learning workflows.
• Lead client workshops, architecture reviews, pre-sales activities, and technical roadmaps.
• Mentor teams and develop reusable frameworks and best practices.

Skills

Databricks expertise

Apache Spark

PySpark/Scala

SQL

Education

Bachelor’s degree in a technical field

Master’s degree or PhD (preferred)

Tools

Delta Lake

Unity Catalog

Delta Live Tables

Photon

MLflow

MLOps

dbt

Terraform

Pulumi

CI/CD pipelines

Job description

Job Title: Databricks Solution Architect – Lead/Principal

Experience: 10+ years overall, including 5+ years of hands‑on Databricks experience

Job Summary

We are seeking a Lead/Principal-level Databricks expert to design and implement enterprise-scale Lakehouse solutions, lead data engineering initiatives, and advise clients on data platform strategy. The ideal candidate will combine deep technical expertise with client‑facing leadership, consulting, and team mentorship.

Key Responsibilities

• Design scalable Databricks Lakehouse architectures using Delta Lake, Unity Catalog, and medallion architecture.
• Lead ETL/ELT pipelines using Apache Spark, PySpark/Scala, and Databricks Workflows.
• Guide cloud deployments across Azure, AWS, or GCP.
• Establish data governance, quality, lineage, and observability standards.
• Support MLflow, MLOps, and production machine learning workflows.
• Lead client workshops, architecture reviews, pre‑sales activities, and technical roadmaps.
• Mentor teams and develop reusable frameworks and best practices.

Required Qualifications

• 10+ years in data engineering, analytics, or platform architecture.
• 5+ years of hands‑on Databricks experience with enterprise production deployments.
• Strong expertise in Apache Spark, PySpark/Scala, SQL, Delta Lake, and Unity Catalog.
• Experience with cloud‑based Lakehouse architecture and data governance.
• Proven client‑facing leadership and consulting/professional services experience.
• Bachelor’s degree in a relevant technical field or equivalent experience.

Preferred Qualifications

• Databricks Professional certification.
• Experience with Delta Live Tables, Photon, MLflow, and MLOps.
• Familiarity with dbt, Terraform/Pulumi, and CI/CD pipelines.
• Master’s degree or Ph.D. in a relevant discipline.