Senior Principal Architect, EDT Data Architecture Strategy, Standards

Jobtailor; Missouri; On-site; USD 150,000 - 230,000; Full time

Job summary

Jobtailor seeks a senior enterprise data architect to own the Azure and Databricks Lakehouse architecture, standards, and roadmaps across the organization. You will partner with engineering, leadership, Microsoft, and Databricks to shape the target state and guard critical design decisions.

This role requires hands-on delivery experience with Azure/Data Lake and Databricks, plus expertise in security, data quality, and governance within regulated environments.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Information Systems, Business, or a related field.
• At least 10 years of progressive experience in data engineering, data architecture, and analytics within large, global enterprises.
• Hands-on delivery using Azure and Databricks Lakehouse platforms.
• Experience architecting and implementing enterprise data platforms and batch or streaming pipelines.
• Experience with Azure, Azure Data Lake Storage, Databricks Spark, Delta Lake, Unity Catalog, Databricks Workflows or Delta Live Tables, and Power BI.
• Experience defining and operationalizing enterprise architecture standards, reference architectures, and architecture review or design authority processes.
• Experience applying data security, privacy, and regulated-environment requirements (GxP, HIPAA).

Responsibilities

• Own the enterprise data and analytics architecture strategy and design patterns.
• Partner with engineering teams, architecture forums, business leaders, Microsoft, and Databricks to guide critical design decisions.
• Define and own the enterprise reference architecture and multi-year roadmaps across Azure Data Lake Storage, Databricks, Delta Lake, Unity Catalog, and BI experiences.
• Publish and maintain design standards and reusable blueprints for lakehouse zoning, Delta table design, ingestion, orchestration, semantic models, security, and access.
• Co-chair the architecture review board and manage governance.
• Intervene in critical technical decisions and architectural drift through design sessions and code reviews.
• Design and build batch and streaming pipelines using CDC, Delta Live Tables, Databricks Workflows, Auto Loader, Azure Data Factory, PySpark, and SQL medallion transformations.
• Review production code and pipeline designs, including Spark jobs and performance tuning.
• Establish lifecycle standards for data quality, testing, CI/CD, observability, and lineage.
• Run proofs of concept and solution health assessments.
• Serve as senior technical counterpart to Microsoft and Databricks evaluating previews and translating vendor direction into architecture implications.
• Assess complex platforms and guide decisions with business representatives.

Skills

Data Architecture

Enterprise Architecture

Technical Leadership

Problem Solving

Communication

Collaboration

Education

Bachelor’s degree in Computer Science, Engineering, Information Systems, Business, or a related field

Tools

Power BI

Databricks Genie

Microsoft Copilot

Azure Data Factory

PySpark

SQL

Databricks Workflows

Delta Live Tables

Delta Lake

Azure Data Lake Storage

Job description

• Own the enterprise data and analytics architecture strategy, standards, and design patterns for the global Azure and Databricks Lakehouse ecosystem
• Partner with engineering teams, architecture forums, business leaders, Microsoft, and Databricks to define the target state and guide critical design decisions
• Define and own the enterprise reference architecture and multi-year roadmap across Azure Data Lake Storage, Databricks, Delta Lake, Unity Catalog, medallion architecture, Power BI, Databricks Genie, and Microsoft Copilot experiences
• Publish and maintain design standards and reusable blueprints for lakehouse zoning, Delta table design, ingestion, orchestration, semantic models, security, and access
• Co-chair the architecture review board, exercise approval rights at defined design gates, maintain Architecture Decision Records, and manage waivers
• Intervene in critical technical decisions and architectural drift through design sessions, code reviews, and hands-on guidance
• Design and build batch and streaming pipelines using change data capture, Delta Live Tables, Databricks Workflows, Auto Loader, Azure Data Factory, PySpark, and SQL medallion transformations
• Review production code and pipeline designs, including Spark jobs, compute configurations, performance tuning, and Databricks Unit efficiency
• Establish lifecycle standards for data quality, pipeline testing, continuous integration and delivery, observability, and lineage
• Run proofs of concept, architecture spikes, and solution health assessments
• Serve as the senior technical counterpart to Microsoft and Databricks by evaluating preview features, influencing roadmaps, and translating vendor direction into architectural implications
• Assess complex platforms, troubleshoot issues, explain technical recommendations and tradeoffs, and partner with business representatives to identify needs and guide decisions

Requirements

• Bachelor’s degree in Computer Science, Engineering, Information Systems, Business, or a related field
• Minimum 10 years of progressive experience in data engineering, data architecture, and analytics within large, global enterprises
• Recent hands‑on delivery using Azure and Databricks Lakehouse platforms
• Experience architecting and implementing enterprise data platforms and batch or streaming pipelines
• Experience with Azure, Azure Data Lake Storage, Databricks Spark, Delta Lake, Unity Catalog, Databricks Workflows or Delta Live Tables, modern data engineering practices, and Power BI
• Experience defining and operationalizing enterprise architecture standards, reference architectures, and architecture review or design authority processes
• Experience applying data security, privacy, and regulated-environment requirements, including GxP, HIPAA, and personally identifiable or protected health information controls
• Azure analytics certification and experience with Databricks Genie and Microsoft Copilot preferred

Core Competencies

Demonstrates expertise in enterprise data architecture and analytics, with a strong focus on Azure and Databricks Lakehouse ecosystems. Capable of defining and implementing architecture standards, managing complex data pipelines, and ensuring data security and compliance.

Highest-signal resume keywords

• Azure Data Lake Storage
• Databricks Lakehouse
• Data Engineering
• Enterprise Architecture
• Data Security Compliance

ATS Optimization Keywords

Hard Skills

• Data Architecture
• Batch and Streaming Pipelines
• Delta Lake
• PySpark
• SQL
• Databricks Workflows
• Change Data Capture
• Performance Tuning
• Data Quality Standards
• Continuous Integration and Delivery

Soft Skills

• Collaboration
• Technical Leadership
• Problem Solving
• Communication

Certifications & Qualifications

• Azure Analytics Certification

Industry Keywords

• GxP
• HIPAA
• Data Privacy
• Regulated Environment
• Enterprise Reference Architecture

Tools & Technologies

• Power BI
• Databricks Genie
• Microsoft Copilot
• Azure Data Factory