Remote Platform Architect - Databricks on Azure

Themesoft Inc; United States; Remote; USD 170,000 - 230,000; Full time

Job summary

Themsoft Inc. is seeking a Platform Architect with Databricks to lead the Azure Databricks Platform's architecture, governance, and security.

You will design and implement scalable Databricks environments, enforce data governance, and integrate with ADF, ADLS Gen2, Key Vault, and Entra ID. Collaborate with Data Engineering, Security, Networking, and Operations teams to optimize performance, reliability, and cost.

Qualifications

• Hands-on with Unity Catalog, Delta Lake, Spark and Databricks components.
• Extensive experience with Azure data services (ADF, ADLS Gen2, Key Vault).
• Experience implementing governance, IAM, and data protection controls.
• Strong networking know-how in Azure (VNets, NSGs, private endpoints).
• Databricks performance tuning, cost optimization, capacity planning, troubleshooting.
• Proficient in CI/CD (Azure DevOps, GitHub Actions), REST APIs, scripting (PowerShell, Python, SQL).
• Security, compliance, and enterprise-scale platform management expertise.

Responsibilities

• Lead architecture and governance of the Azure Databricks Platform.
• Design secure, scalable Databricks environments using Unity Catalog.
• Implement data governance and fine-grained access controls.
• Manage integrations with ADF, ADLS Gen2, Key Vault, and Entra ID.
• Drive platform performance, reliability, and cost management.
• Collaborate with Data Engineering, Security, Networking, and Operations.
• Define architecture standards and operational runbooks.

Skills

Unity Catalog

Delta Lake

Spark

Databricks Clusters

Databricks Jobs

Databricks Notebooks

Databricks Repos

Azure Data Factory

ADLS Gen2

Key Vault

Entra ID/Azure AD

Azure Monitor

Log Analytics

SCIM

SSO

RBAC

ACLs

Data Governance

Azure Networking

VNets

NSGs

Private Endpoints

Firewall Rules

DNS

Routing

Performance tuning

Cost optimization

Capacity planning

Troubleshooting

CI/CD

Azure DevOps

GitHub Actions

REST APIs

PowerShell

Python

Scala

SQL

Azure CLI

Cloud security

Compliance

Enterprise-scale platform management

Tools

Azure DevOps

GitHub Actions

Job description

Themsoft Inc. is seeking a Platform Architect with Databricks to lead the Azure Databricks Platform's architecture, governance, and security.

You will design and implement scalable Databricks environments, enforce data governance, and integrate with ADF, ADLS Gen2, Key Vault, and Entra ID. Collaborate with Data Engineering, Security, Networking, and Operations teams to optimize performance, reliability, and cost.