Senior Data Architect, Azure & Databricks Lakehouse

Jobtailor; Missouri; On-site; USD 150,000 - 230,000; Full time

Job summary

Jobtailor seeks a senior enterprise data architect to own the Azure and Databricks Lakehouse architecture, standards, and roadmaps across the organization. You will partner with engineering, leadership, Microsoft, and Databricks to shape the target state and guard critical design decisions.

This role requires hands-on delivery experience with Azure/Data Lake and Databricks, plus expertise in security, data quality, and governance within regulated environments.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Information Systems, Business, or a related field.
• At least 10 years of progressive experience in data engineering, data architecture, and analytics within large, global enterprises.
• Hands-on delivery using Azure and Databricks Lakehouse platforms.
• Experience architecting and implementing enterprise data platforms and batch or streaming pipelines.
• Experience with Azure, Azure Data Lake Storage, Databricks Spark, Delta Lake, Unity Catalog, Databricks Workflows or Delta Live Tables, and Power BI.
• Experience defining and operationalizing enterprise architecture standards, reference architectures, and architecture review or design authority processes.
• Experience applying data security, privacy, and regulated-environment requirements (GxP, HIPAA).

Responsibilities

• Own the enterprise data and analytics architecture strategy and design patterns.
• Partner with engineering teams, architecture forums, business leaders, Microsoft, and Databricks to guide critical design decisions.
• Define and own the enterprise reference architecture and multi-year roadmaps across Azure Data Lake Storage, Databricks, Delta Lake, Unity Catalog, and BI experiences.
• Publish and maintain design standards and reusable blueprints for lakehouse zoning, Delta table design, ingestion, orchestration, semantic models, security, and access.
• Co-chair the architecture review board and manage governance.
• Intervene in critical technical decisions and architectural drift through design sessions and code reviews.
• Design and build batch and streaming pipelines using CDC, Delta Live Tables, Databricks Workflows, Auto Loader, Azure Data Factory, PySpark, and SQL medallion transformations.
• Review production code and pipeline designs, including Spark jobs and performance tuning.
• Establish lifecycle standards for data quality, testing, CI/CD, observability, and lineage.
• Run proofs of concept and solution health assessments.
• Serve as senior technical counterpart to Microsoft and Databricks evaluating previews and translating vendor direction into architecture implications.
• Assess complex platforms and guide decisions with business representatives.

Skills

Data Architecture

Enterprise Architecture

Technical Leadership

Problem Solving

Communication

Collaboration

Education

Bachelor’s degree in Computer Science, Engineering, Information Systems, Business, or a related field

Tools

Power BI

Databricks Genie

Microsoft Copilot

Azure Data Factory

PySpark

SQL

Databricks Workflows

Delta Live Tables

Delta Lake

Azure Data Lake Storage

Job description

Jobtailor seeks a senior enterprise data architect to own the Azure and Databricks Lakehouse architecture, standards, and roadmaps across the organization. You will partner with engineering, leadership, Microsoft, and Databricks to shape the target state and guard critical design decisions.

This role requires hands-on delivery experience with Azure/Data Lake and Databricks, plus expertise in security, data quality, and governance within regulated environments.