Databricks Field ARCHITECT -- Data Modernization (Databricks)
Employment Type: FTE role
Project Overview:
We are undertaking a Data Modernization initiative to migrate data from multiple legacy on-prem and cloud systems into Databricks, enabling a unified, scalable, and analytics-ready data platform. The program focuses on modernizing data ingestion, transformation, governance, and reporting while ensuring security, performance, and cost optimization.
Role Summary
We are looking for an experienced Databricks Field ARCHITECT who has led or significantly contributed to data modernization projects using Databricks. The Field ARCHITECT will be responsible for end-to-end architecture design, migration strategy, and technical leadership for moving legacy data platforms into a modern Databricks-based ecosystem.
Key Responsibilities
- Design and own the end-to-end data architecture for migration from legacy systems (on-prem databases, data warehouses, flat files, ETL tools) to Databricks
- Define target-state architecture leveraging Databricks components such as:
- Unity Catalog (unified governance & data lakehouse storage)
- Delta Lake Lakehouse & Databricks SQL Warehouses
- Power BI / Databricks SQL semantic models & dashboards
- Establish architectural standards, design patterns, and best practices
Data Modernization & Migration
- Assess existing legacy data platforms and define migration and modernization strategy
- Lead data ingestion, transformation, and orchestration using Databricks Workflows / Delta Live Tables
- Design scalable ELT/ETL pipelines and incremental data loads
- Plan and execute phased migrations with minimal business disruption
Governance, Security & Performance
- Implement data governance, security, and compliance using Unity Catalog (governance & lineage) and Databricks security models
- Define data access, role-based security, and data sharing strategies
- Optimize performance, storage, and compute costs within Databricks
- Ensure data quality, lineage, and observability
- Work closely with business stakeholders, product owners, and analytics teams to translate requirements into architecture
- Work closely with Databricks Alliance and Partner channels
- Provide technical leadership to data engineers and BI developers
- Review designs, code, and implementation for alignment with architecture
- Support testing, cutover, and post-migration stabilization
Required Skills & Experience
Must Have
- 8+ years of overall data & cloud experience with strong Databricks architecture background
- Delta Lake Lakehouse & Databricks SQL Warehouses
- Cloud data lake storage (ADLS Gen2 / S3 / GCS) with Unity Catalog
- Power BI (enterprise semantic models)
- Hands-on experience with Databricks in at least one data modernization or migration project
- Delta Lake Lakehouse & Databricks SQL Warehouses
- Cloud data lake storage (ADLS Gen2 / S3 / GCS) with Unity Catalog
- Power BI (enterprise semantic models)
- Experience migrating from legacy systems (on-prem databases, traditional DWs, legacy ETL tools)
- Strong SQL and data modeling skills