Azure Databricks Lakehouse Architect for Enterprise Platform

GovCIO; Atlanta (GA); Remote; USD 175,000 - 195,000; Full time

Benefits offered by this job

EAP

Corporate Discounts

Learning & Development platform

Certification Assistance

Referral Bonus Program

Internal Mobility Program

Pet Insurance

Flexible Work Environment

Job summary

GovCIO is seeking a Databricks Solutions Expert to architect and implement a governed Azure Databricks Lakehouse for VA Data Modernization. You'll lead platform design, security, and CI/CD, enabling thousands of analytics teams across the enterprise.

The role blends platform engineering with data engineering, including data ingestion, transformation, ML lifecycle, and cost-conscious operations, all delivered from a fully remote base in the United States.

Qualifications

• Bachelor’s degree in Information Technology or a related field (or commensurate experience).
• 12+ years of experience in data engineering/analytics; 5+ years building on cloud data platforms (Azure preferred).
• 3+ years hands-on Azure Databricks (platform + pipelines) and Delta Lake.
• Proven experience setting up Unity Catalog with granular governance (RLS/CLS).
• Deep knowledge of Azure networking (VNets, Private Link, NSGs), identity (Entra ID), Key Vault, ADLS Gen2, Event Hubs, Azure SQL/MI, and Data Factory.
• Strong Spark expertise (PySpark/SQL), Structured Streaming, performance tuning, partitioning and storage optimization.
• Practical Terraform experience for Databricks/Azure resources; CI/CD with Azure DevOps or GitHub Actions.
• Security-first mindset; track record implementing audit logging, policy-as-code, and compliance controls.
• Excellent communication skills; ability to standardize, teach, and influence at enterprise scale.
• Experience operating platforms for >500 concurrent users and 1000s of analytics teams.
• Knowledge of Photon, DLT, Workflows, Lakehouse ML (MLflow, feature store), Delta Sharing.
• Exposure to FinOps and chargeback models for data platforms.
• Experience with Synapse/Fabric interoperability, and data virtualization patterns.
• Background in data modeling (medallion, dimensional, domain‑driven design) and data quality (SLAs).
• Databricks certifications (preferred)

Responsibilities

• Define platform patterns and build reference implementations for a multi-tenant Databricks Lakehouse.
• Set standards (cluster policies, Unity Catalog governance, CI/CD) and enable teams to deliver scalable insights.
• Architect Azure Databricks landing zone and secure connectivity to data sources.
• Develop governance, data protection, and policy-as-code frameworks across regions.
• Build pipelines for batch/streaming with Delta Live Tables and CDC via Auto Loader.
• Lead cost-aware engineering with FinOps practices and observability across notebooks and jobs.

Skills

Azure Databricks

Unity Catalog

Delta Lake

Spark (PySpark/SQL)

Structured Streaming

Governance & security

Cross-functional leadership

CI/CD

Networking & security

Data modeling & medallion design

Education

Bachelor’s degree in Information Technology or related field

Tools

Terraform

Azure DevOps

GitHub Actions

dbx

MLflow

Delta Sharing

Photon

Private Link

Azure Data Factory / Synapse

Job description

GovCIO is seeking a Databricks Solutions Expert to architect and implement a governed Azure Databricks Lakehouse for VA Data Modernization. You'll lead platform design, security, and CI/CD, enabling thousands of analytics teams across the enterprise.

The role blends platform engineering with data engineering, including data ingestion, transformation, ML lifecycle, and cost-conscious operations, all delivered from a fully remote base in the United States.