Databricks Platform Architect — Azure & Governance

Blueflag-LLP; Dallas (TX); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Health and dental plans

401(k) with company match

Life insurance and AD&D

Job summary

BlueFlag seeks a Databricks Solutions Engineer to architect and govern a premier data and AI platform for the VA. You will design the Databricks foundation in Azure, establish Unity Catalog governance, and define lakehouse standards while building scalable pipelines and MLOps patterns to support thousands of analytics teams.

You will collaborate with security, networking, and VA stakeholders to ensure compliant, auditable platforms and reusable templates, enabling rapid adoption across teams.

Qualifications

• Requires 12+ years in data engineering/analytics with 5+ years on cloud data platforms (Azure preferred).
• 3+ years hands-on with Databricks and Delta Lake.
• Proven Unity Catalog implementation with granular governance and security.

Responsibilities

• Design the Databricks platform foundation in Azure Commercial including workspace topology and secure connectivity.
• Set Unity Catalog governance with data classification, access controls, and lineage.
• Define lakehouse standards for data flow, table layout, and performance optimization.
• Build reference pipelines for batch, streaming, and CDC using Lakeflow and Structured Streaming.
• Define MLOps patterns with MLflow, feature stores, and model serving.
• Set platform guardrails: policies, tagging, budget, monitoring, and audits.

Skills

Platform scale

MLflow

FinOps

Azure interoperability

Data modeling

Healthcare data

Databricks/Delta Lake

Terraform

CI/CD tooling

Education

Bachelor's degree in information technology or related field

Tools

Databricks

Delta Lake

Terraform

Azure DevOps

GitHub Actions

Azure Synapse

Microsoft Fabric

Job description

BlueFlag seeks a Databricks Solutions Engineer to architect and govern a premier data and AI platform for the VA. You will design the Databricks foundation in Azure, establish Unity Catalog governance, and define lakehouse standards while building scalable pipelines and MLOps patterns to support thousands of analytics teams.

You will collaborate with security, networking, and VA stakeholders to ensure compliant, auditable platforms and reusable templates, enabling rapid adoption across teams.