Remote Senior Azure Databricks Platform Architect

Lumenalta; United States; Remote; USD 80,000 - 150,000; Full time

Benefits offered by this job

Health insurance

401K Contribution

Professional development fund

15 days paid time off

Soft-skill development courses

Flexible remote hours

Job summary

Lumenalta is seeking a Senior Azure Databricks Engineer to design and deliver enterprise lakehouse platforms on Databricks and Azure. You will own architecture, governance, and pipelines, setting technical standards and mentoring the delivery team.

You will collaborate with stakeholders to translate business goals into platform roadmaps, ensuring scalable, secure, and cost-efficient solutions across cloud resources. This role requires leadership and deep technical expertise in data platforms.

Qualifications

• 7+ years of professional experience in data/software engineering or data platform roles, with Databricks in production.
• Solution architect/tech lead experience on enterprise Databricks implementations.
• Expert-level Python, PySpark, and SQL with automated testing via PyTest.

Responsibilities

• Lead end-to-end architecture for enterprise lakehouse platforms on Databricks and Azure.
• Design Unity Catalog strategies, access control, lineage, and data sharing.
• Architect and build scalable batch and streaming pipelines in Python, PySpark, SQL with Delta Lake.
• Define and enforce testing, code reviews, Git workflows, CI/CD, and asset packaging with Databricks Bundles.
• Own Terraform provisioning of Databricks workspaces and Azure resources.
• Mentor engineers, review architecture and code, elevate delivery standards.
• Act as senior technical point of contact for client stakeholders and roadmaps.

Skills

Python

PySpark

SQL

Databricks

Azure

Terraform

CI/CD

Git

PyTest

Unity Catalog

Education

Bachelor's degree in CS/Engineering

Master's degree

Tools

Delta Lake

Lakeflow

Databricks Asset Bundles

Unity Catalog

Job description

Lumenalta is seeking a Senior Azure Databricks Engineer to design and deliver enterprise lakehouse platforms on Databricks and Azure. You will own architecture, governance, and pipelines, setting technical standards and mentoring the delivery team.

You will collaborate with stakeholders to translate business goals into platform roadmaps, ensuring scalable, secure, and cost-efficient solutions across cloud resources. This role requires leadership and deep technical expertise in data platforms.