Databricks Platform Architect & Governance Lead

Blueflag-LLP; Salt Lake City (UT); On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Competitive salary

Generous annual leave and holidays

Health and dental plans

401(k) with company match

Life insurance and AD&D

Ongoing training and development

Job summary

BlueFlag is hiring as a Databricks Solutions Engineer to establish the platform standards for a premier data and AI platform for the VA. You will shape workspace topology, security, governance, and reference implementations, guiding thousands of teams on analytics, reporting, and ML workloads.

You’ll work with Unity Catalog governance, medallion data flows, and high-performance lakehouse design, while building reusable templates and conducting workshops to accelerate adoption across departments.

Qualifications

• Experience building production data pipelines on Databricks.
• Ability to design platform governance and security controls.
• Proven track record delivering reference implementations and workshops.

Responsibilities

• Design the Databricks platform foundation in Azure Commercial with Terraform.
• Set Unity Catalog governance including security, lineage and access controls.
• Define lakehouse standards for medallion data flow and performance optimization.
• Build reference pipelines for batch, streaming, and CDC using Lakeflow and Auto Loader.
• Establish MLOps patterns with MLflow and feature stores; model serving.
• Implement guardrails for cost, tagging, monitoring, and audit logging in Azure Monitor.
• Create reusable templates and run workshops to enable teams to adopt them.
• Collaborate with security, networking, compliance, and VA stakeholders on standards and adoption.

Skills

Databricks

Unity Catalog

Spark (PySpark)

Structured Streaming

Delta Lake

MLflow

Terraform

Azure

CI/CD (Azure DevOps/GitHub Actions)

Security & Governance

FinOps/Chargeback

Data Modeling (dimensional)

Healthcare data (HL7/FHIR/OMOP)

Education

Bachelor's degree in IT or related field

Tools

Lakeflow Declarative Pipelines

Lakeflow Jobs

Auto Loader

Databricks Asset Bundles

Terraform Databricks provider

Job description

BlueFlag is hiring as a Databricks Solutions Engineer to establish the platform standards for a premier data and AI platform for the VA. You will shape workspace topology, security, governance, and reference implementations, guiding thousands of teams on analytics, reporting, and ML workloads.

You’ll work with Unity Catalog governance, medallion data flows, and high-performance lakehouse design, while building reusable templates and conducting workshops to accelerate adoption across departments.