Senior Databricks Engineer: Customer-Facing Data & AI

BlueFlag LLC; Salt Lake City (UT); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Competitive salary

Generous annual leave

Health plans

401(k) with match

Life insurance

Ongoing training

Job summary

BlueFlag LLC is hiring Senior Databricks Engineers to help VA teams move their data work to a premier data and AI platform built on Databricks in Azure. The role is hands-on and customer-facing, with a focus on migrating on-prem workloads to the cloud and teaching teams to operate the platform confidently.

The two focus areas—AI/ML and Analytics—offer opportunities to build end-to-end ML workflows, deploy models with MLflow, and modernize ETL and reporting with Databricks SQL and Power BI.

Qualifications

• 7+ years in data engineering, including 2+ years building production workloads on Databricks.
• Strong proficiency in Python, SQL, PySpark, and Spark SQL.
• Hands-on experience with Delta Lake, lakehouse design, and Spark performance tuning.
• Hands-on Unity Catalog experience: catalogs, grants, lineage, and security.
• Experience migrating on-prem workloads to the cloud (e.g., SQL Server, SSIS).
• Experience with Azure services (ADLS Gen2, Azure Data Factory, Entra ID, Key Vault).
• Experience with Git, CI/CD, and infrastructure as code (Databricks Asset Bundles, Terraform).
• Customer-facing consulting or professional services experience; clear communication.

Responsibilities

• Work directly with VA teams to scope use cases, plan migrations, and deliver solutions on Databricks.
• Assess on-prem workloads and adapt to Databricks in Azure Commercial.
• Build and tune pipelines with PySpark, Spark SQL, Delta Lake, Lakeflow, and Azure Data Factory.
• Use Unity Catalog for access control and data governance during migration.
• Teach customers via workshops, pairing, and documentation to enable self-sufficiency.
• Package reusable templates and code to accelerate future migrations.

Skills

Python

SQL

PySpark

Spark SQL

Delta Lake

Unity Catalog

Git

CI/CD

Terraform

Databricks

Azure Data Factory

Education

Bachelor's degree

Tools

Databricks Asset Bundles

Terraform

Power BI

Azure Data Factory

Entra ID

Key Vault

Job description

BlueFlag LLC is hiring Senior Databricks Engineers to help VA teams move their data work to a premier data and AI platform built on Databricks in Azure. The role is hands-on and customer-facing, with a focus on migrating on-prem workloads to the cloud and teaching teams to operate the platform confidently.

The two focus areas—AI/ML and Analytics—offer opportunities to build end-to-end ML workflows, deploy models with MLflow, and modernize ETL and reporting with Databricks SQL and Power BI.