Senior Databricks Data Platform Architect & AI Solutions Lead

UNISON Group; California City (CA); On-site; USD 150,000 - 230,000; Full time

Job summary

UNISON Group is building a fast-growing Databricks practice delivering enterprise data and AI solutions across global clients. As Lead Solution Architect – Data Engineering, you will be the technical anchor of the practice: leading solution design on client engagements, owning architectures in presales, and driving large-scale migrations and cloud transformations.

This hands-on leader mentors engineers, creates accelerators, and shapes offerings while ensuring secure, scalable Lakehouse

Qualifications

• 12+ years in data engineering and architecture.
• 3+ years using Databricks at enterprise scale.
• Strong Spark performance tuning and debugging skills.
• Lakehouse fluency including Delta Lake and Unity Catalog.
• Experience leading large migrations and cloud transformations.
• Presales experience and ability to present to CIO/CTO.
• Proficiency in Python/SQL/Scala and CI/CD for data platforms.
• Ability to convert delivery success into reusable assets and offerings.

Responsibilities

• Own end-to-end architecture and design decisions on Databricks engagements.
• Lead production-grade data platforms ingestion, transformation, governance, and BI/ML enablement.
• Lead large-scale migrations and cloud transformation projects to Databricks on Azure/AWS/GCP.
• Stay hands-on with performance tuning, debugging, and code/design reviews.

Skills

Databricks

Data engineering

Scala

Python

SQL

CI/CD for data platforms

Spark

Presales

Stakeholder management

Lakehouse

Tools

Unity Catalog

Workflows

Airflow

DLT

MLflow

OpenAI API

Anthropic

Microsoft Fabric

Delta Lake

Spark UI

Job description

UNISON Group is building a fast-growing Databricks practice delivering enterprise data and AI solutions across global clients. As Lead Solution Architect – Data Engineering, you will be the technical anchor of the practice: leading solution design on client engagements, owning architectures in presales, and driving large-scale migrations and cloud transformations.

This hands-on leader mentors engineers, creates accelerators, and shapes offerings while ensuring secure, scalable Lakehouse