Enterprise Data Architect: Azure Databricks & AI

ShyftLabs; United States; Remote; USD 114,000 - 135,000; Full time

Job summary

ShyftLabs is seeking an experienced Data Architect to lead architectural direction for enterprise data platforms. You will work directly with client stakeholders and distributed engineering teams to translate complex requirements into scalable, secure data solutions.

The role combines solution architecture, technical consulting, and hands-on delivery oversight, with emphasis on data governance, Medallion architecture, and performance optimization.

Qualifications

• 8+ years of experience in data engineering or data architecture.
• Client-facing technical role experience with enterprise customers.
• Proficient with Azure Databricks and Delta Lake.
• Knowledge of Unity Catalog and data governance.
• Strong SQL and Python/PySpark skills.
• Experience with Apache Airflow and dbt Core.
• Ability to translate business requirements into scalable architecture.

Responsibilities

• Lead client-facing architecture discussions translating business needs into scalable data solutions.
• Define enterprise data architecture using Azure Databricks, Delta Lake and cloud data tech.
• Drive technical discovery, workshops, and architecture reviews to define target-state architectures.
• Provide hands-on leadership with SQL/Python/PySpark, Airflow, and dbt Core.
• Guide data pipeline development using Databricks Lakeflow Connect and Auto Loader.
• Establish architecture standards and reusable patterns across projects.
• Implement Medallion Architecture (Bronze/Silver/Gold) for data layers.
• Drive data governance, Unity Catalog, and data access controls.
• Oversee delivery quality: architecture designs, data models, and pipelines.
• Champion data quality, monitoring, and reliability in production.
• Support CI/CD and automation across environments.
• Advise on performance optimization and cloud cost efficiency.
• Coordinate distributed engineering teams and communicate risks.

Skills

Client-facing

Architectural leadership

Data platform design

Cloud architectures

Communication

Tools

Azure Databricks

Delta Lake

Unity Catalog

SQL

Python/PySpark

Apache Airflow

dbt Core

Lakeflow Connect

Auto Loader

Git

Job description

ShyftLabs is seeking an experienced Data Architect to lead architectural direction for enterprise data platforms. You will work directly with client stakeholders and distributed engineering teams to translate complex requirements into scalable, secure data solutions.

The role combines solution architecture, technical consulting, and hands-on delivery oversight, with emphasis on data governance, Medallion architecture, and performance optimization.