Azure Databricks Platform Architect — Lakehouse & Governance

Planned Systems International; Northern (KY); Hybrid; USD 140,000 - 190,000; Full time

Benefits offered by this job

Health insurance

Dental & vision insurance

Short-term disability

Long-term disability

Life insurance

AD&D coverage

401(k) with company match

Flexible spending account

Job summary

Planned Systems International is hiring a Databricks Solutions Expert to define platform patterns, build reference implementations, set standards, and drive enablement for product, analytics, and data science teams at scale.

The role focuses on platform architecture, governance, and cost-aware operations across Azure Databricks, Delta Lake, and Unity Catalog, enabling reliable, compliant data insights at scale.

Qualifications

• Bachelor’s degree in Information Technology or a related field (or commensurate experience)
• 12+ years in data engineering/analytics; 5+ years building on cloud data platforms (Azure preferred)
• 3+ years hands-on Azure Databricks (platform + pipelines) and Delta Lake
• Proven Unity Catalog governance experience (RLS/CLS)
• Deep knowledge of Azure networking, Entra ID, Key Vault, ADLS Gen2, Event Hubs, Azure SQL/MI, and Data Factory
• Strong Spark (PySpark/SQL), Structured Streaming, performance tuning
• Terraform for Databricks/Azure resources; CI/CD with Azure DevOps or GitHub Actions
• Security-first mindset; audit logging, policy-as-code, compliance controls
• Excellent communication; able to standardize and influence enterprise-scale
• Active Public Trust clearance

Responsibilities

• Platform Architecture & Design: blueprint the Azure Databricks landing zone, workspace topology, and secure connectivity to data sources.
• Governance & Access: Unity Catalog governance, data lineage, cross-domain sharing patterns, encryption, and audit logging.
• Engineering & Enablement: build DLT pipelines, optimize notebooks and ETL, MLOps with MLflow, observability and reference accelerators.
• DevOps, Automation & Cost Management: IaC provisioning, CI/CD pipelines, FinOps, cost governance and optimization.
• Stakeholder Management & Governance: partner with Security, Networking, Compliance, and FinOps; establish a Lakehouse Platform Council.

Job description

Planned Systems International is hiring a Databricks Solutions Expert to define platform patterns, build reference implementations, set standards, and drive enablement for product, analytics, and data science teams at scale.

The role focuses on platform architecture, governance, and cost-aware operations across Azure Databricks, Delta Lake, and Unity Catalog, enabling reliable, compliant data insights at scale.