Azure Databricks Architect: Lakehouse & Governance

Airswift; Glendale (AZ); On-site; USD 140,000 - 170,000; Full time

Job summary

Airswift is seeking a Senior Azure Databricks Engineer in Glendale, AZ to design and implement scalable enterprise data platforms in a modern Azure environment. You will work across batch, streaming, ELT/ETL, and real-time analytics workloads with emphasis on Databricks, Delta Lake, Unity Catalog, and ADLS Gen2.

This role involves platform architecture, governance, security, performance optimisation, and migration towards a Lakehouse architecture while supporting enterprise data pipelines and

Qualifications

• 8–10 years of experience designing and implementing enterprise data platforms.
• 5+ years of hands-on experience with Azure Databricks in enterprise environments.
• Experience architecting modern Lakehouse solutions using Azure Databricks and Delta Lake.
• Experience administering Azure Databricks workspaces, clusters, Unity Catalog, compute policies, job orchestration, and workspace security.
• Experience implementing enterprise data governance including metadata management, data lineage, and fine-granular access controls.
• Experience designing enterprise security architectures including RBAC, managed identities, private endpoints, Key Vault integration, encryption, and network security.
• Experience implementing enterprise data quality frameworks, monitoring, observability, and operational dashboards.
• Experience supporting migration of legacy enterprise data warehouses, ETL solutions, and reporting platforms to Azure Databricks and modern Lakehouse architecture.
• Experience providing technical support and troubleshooting for production incidents related to Databricks, Spark workloads, data pipelines, and platform infrastructure

Skills

Azure Databricks

Delta Lake

Unity Catalog

Azure Data Lake Gen2

Apache Spark

PySpark

Spark SQL

SQL

Python

Data Modeling

Security Architecture

CI/CD Azure DevOps

Monitoring & Dashboards

Cost Optimization

Tools

Azure DevOps

Azure Monitor

Log Analytics

Application Insights

Databricks

Job description

Airswift is seeking a Senior Azure Databricks Engineer in Glendale, AZ to design and implement scalable enterprise data platforms in a modern Azure environment. You will work across batch, streaming, ELT/ETL, and real-time analytics workloads with emphasis on Databricks, Delta Lake, Unity Catalog, and ADLS Gen2.

This role involves platform architecture, governance, security, performance optimisation, and migration towards a Lakehouse architecture while supporting enterprise data pipelines and