Databricks Platform Architect & Data Product Lead

Allata, LLC; United States; Remote; USD 170,000 - 210,000; Full time

Job summary

Allata is seeking a Databricks Manager to lead client-facing data platform implementations. You will define the Lakehouse/EDW architecture, establish governance and security patterns, and guide multi-tenant data products built on Databricks and Delta Lake across engagements.

This role combines high-impact architectural leadership with hands-on engineering, mentoring data teams, collaborating with data product owners, security, and BI to deliver scalable, cost-efficient data platforms.

Qualifications

• Architectural leadership on enterprise data platforms.
• Hands-on with Databricks technologies and Spark.
• Design and implement data governance, security, and lineage.
• Experience with cloud data warehouses and lakehouses.
• Familiarity with ETL/ELT tooling and SaaS connectors.

Responsibilities

• Define overall data platform architecture and reference patterns.
• Design data models for multi-tenant vertical products.
• Establish governance, cataloging, lineage, and data contracts.
• Define security controls and compliance for data platforms.
• Plan scalability, HA, DR, and cost management.
• Lead selection and integration of platform components.
• Design CI/CD for data artifacts and automated deployments.
• Define ingestion patterns and storage layout.
• Specify observability with metrics and dashboards.
• Mentor data engineering teams and perform reviews.
• Collaborate with stakeholders to translate requirements into solutions.
• Develop and deploy processing modules using Spark and SQL.

Skills

Databricks

Spark PySpark/Scala

Data platform architecture

Data governance

Security IAM

Leadership

CI/CD for data

Tools

Delta Lake

Delta Live Tables

Unity Catalog

Fivetran

Azure Data Factory

Data Fabric

SQL Server

PostgreSQL

Oracle

Job description

Allata is seeking a Databricks Manager to lead client-facing data platform implementations. You will define the Lakehouse/EDW architecture, establish governance and security patterns, and guide multi-tenant data products built on Databricks and Delta Lake across engagements.

This role combines high-impact architectural leadership with hands-on engineering, mentoring data teams, collaborating with data product owners, security, and BI to deliver scalable, cost-efficient data platforms.