Remote Azure Databricks Platform Architect

Planned Systems International, Inc.; United States; Remote; USD 180,000 - 240,000; Full time

Benefits offered by this job

Paid leave

Health insurance

401(k) with match

Professional courses

Tuition reimbursement

Job summary

Planned Systems International, Inc. is seeking a Databricks Solution Expert to define platform patterns, build reference implementations, and drive enablement across product, analytics, and data science teams.

You will implement security, governance, and cost controls while delivering scalable, compliant insights at enterprise scale. You will blueprint landing zones, design lakehouse patterns, establish multi-workspace tenancy, and partner with Security, FinOps, and Compliance to codify

Qualifications

• 12+ years of experience in data engineering/analytics; 5+ years building on cloud data platforms (Azure preferred).
• 3+ years hands-on Azure Databricks (platform + pipelines) and Delta Lake.
• Proven experience setting up Unity Catalog with granular governance (RLS/CLS).
• Deep knowledge of Azure networking (VNets, Private Link, NSGs), identity (Entra ID), Key Vault, ADLS Gen2, Event Hubs, Azure SQL/MI, and Data Factory.
• Strong Spark expertise (PySpark/SQL), Structured Streaming, performance tuning, partitioning and storage optimization.
• Practical Terraform experience for Databricks/Azure resources; CI/CD with Azure DevOps or GitHub Actions.
• Security-first mindset; track record implementing audit logging, policy-as-code, and compliance controls.
• Excellent communication skills; ability to standardize, teach, and influence at enterprise scale.
• Active Public Trust clearance

Responsibilities

• Blueprint the Azure Databricks landing zone: workspace topology (prod/non-prod), network architecture, secure connectivity to data sources.
• Governance with Unity Catalog: multi-region metastores, catalog/schema/table design, data classification tiers, row/column-level security, data lineage, and cross-domain sharing patterns.
• Lakehouse foundations: Delta Lake storage design, medallion flow, partitioning, OPTIMIZE/VACUUM, and performance practices (Photon, AQE).
• Scalability for thousands of teams: multi-workspace strategy, tenancy model, workspace baselines, cluster policy tiers, guardrails for cost and isolation.
• Reliability: HA/DR strategy, regional deployments, backup/restore, versioning, and Terraform-based provisioning.

Skills

Azure Databricks

Unity Catalog

Terraform

Azure DevOps

PySpark

SQL

Security

CI/CD

Education

Bachelor's degree in Information Technology or related field

Tools

Terraform

Azure DevOps

GitHub Actions

dbx

Unity Catalog

Job description

Planned Systems International, Inc. is seeking a Databricks Solution Expert to define platform patterns, build reference implementations, and drive enablement across product, analytics, and data science teams.

You will implement security, governance, and cost controls while delivering scalable, compliant insights at enterprise scale. You will blueprint landing zones, design lakehouse patterns, establish multi-workspace tenancy, and partner with Security, FinOps, and Compliance to codify