Senior Data Platform Architect (Databricks & Lakehouse)

Allata, LLC; Dallas (TX); On-site; USD 130,000 - 180,000; Full time

Job summary

Allata, a global consulting and technology services firm, seeks a Databricks Manager to lead enterprise data platform implementations. You will own architecture, security, scalability, and data product delivery on Lakehouse/EDW platforms, with hands-on Spark and Databricks work.

You will mentor teams, set governance standards, and collaborate with product owners and security teams to drive scalable data solutions for major clients.

Qualifications

• Previous experience as architect or lead in enterprise data platforms.
• Hands-on experience with Databricks technologies (Delta Lake, Unity Catalog, Delta Live Tables).
• Strong expertise in Spark and distributed job optimization.

Responsibilities

• Define the overall data platform architecture (Lakehouse/EDW), including reference patterns and integration blueprint.
• Design data models to support multi-tenant and vertical-specific data products; standardize data layers.
• Establish data governance, metadata, cataloging, lineage, data contracts, and data classification practices.
• Define security and compliance controls (RBAC/IAM, encryption, masking, network segmentation).
• Architect scalability, high availability, DR, and cost management for cloud/hybrid deployments.
• Lead selection and integration of platform components (Databricks, Delta Lake, Fivetran, ADF).
• Design and enforce CI/CD for data artifacts and automated deployments.
• Define ingestion patterns (batch/streaming), partitioning, and storage layout.
• Specify observability: metrics, SLAs, dashboards, logging, tracing, alerting.
• Mentor Data Engineering teams; perform architecture/code reviews.
• Collaborate with stakeholders to translate requirements into technical roadmaps.
• Design, develop, test, and deploy Spark-based processing modules.

Skills

Spark (PySpark/Scala)

Data platform architecture

Data governance

Cloud data platforms

Leadership/mentorship

SQL/ETL/ELT

Tools

Databricks

Delta Lake

Unity Catalog

Delta Live Tables

Fivetran

Airflow

Azure Data Factory

Job description

Allata, a global consulting and technology services firm, seeks a Databricks Manager to lead enterprise data platform implementations. You will own architecture, security, scalability, and data product delivery on Lakehouse/EDW platforms, with hands-on Spark and Databricks work.

You will mentor teams, set governance standards, and collaborate with product owners and security teams to drive scalable data solutions for major clients.