Architecting Modern Data Lakes on Azure Databricks

Omniskope, Inc; Milpitas (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Omniskope, Inc. seeks an Enterprise Data Architect to define and govern a modern data platform with a strong focus on Azure Databricks, data modernization, security, and governance.

This role leads migration from legacy EDW to a scalable Lakehouse architecture and sets standards for security, governance, and data product development. You will drive end-to-end data architecture, create reusable frameworks, and collaborate with product, engineering, and business stakeholders to shape the data

Qualifications

• Strong experience leading EDW modernization and cloud migration initiatives.
• Deep understanding of Lakehouse Architecture, Delta Lake, and Medallion Architecture.
• Background in Information Security, Data Governance, and enterprise data management.
• Experience implementing data governance frameworks, metadata management, data lineage, and data quality standards.
• Knowledge of Azure security services, RBAC, encryption, identity management, and compliance frameworks.
• Experience designing enterprise-scale data products and cloud-native data architectures.
• Excellent stakeholder management and architectural leadership skills.
• 10+ years of Data Engineering or Data Architecture experience, with at least 5 years focused on Azure Databricks.
• Experience in consulting or enterprise transformation projects is highly preferred.

Responsibilities

• Own the end-to-end architecture for enterprise data platforms built on Azure Databricks.
• Lead enterprise-scale migration initiatives from legacy EDW platforms to Azure Databricks.
• Design and govern Lakehouse solutions using Medallion Architecture (Bronze, Silver, Gold).
• Define enterprise data architecture standards, reusable frameworks, and best practices.
• Design scalable enterprise data products supporting analytics, reporting, and business operations.
• Architect data ingestion and transformation strategies across enterprise systems (HR, Compliance, Customer, Service).
• Establish enterprise data governance frameworks, including data quality, metadata management, lineage, classification, lifecycle management.
• Define security architecture, including identity management, RBAC, encryption, and data protection strategies.
• Ensure compliance with enterprise security, governance, privacy, and regulatory requirements.
• Review and approve architectural decisions related to integrations, data models, platform performance, and scalability.
• Provide technical leadership and architectural guidance to engineering teams throughout the project lifecycle.
• Collaborate with product managers, engineering teams, and business stakeholders to define the enterprise data roadmap.

Skills

EDW modernization

Azure Databricks

Lakehouse architecture

Medallion Architecture

Information security

Data governance

Data quality

RBAC security

Data ingestion

Stakeholder management

Cloud-native data

Enterprise data migration

Job description

Omniskope, Inc. seeks an Enterprise Data Architect to define and govern a modern data platform with a strong focus on Azure Databricks, data modernization, security, and governance.

This role leads migration from legacy EDW to a scalable Lakehouse architecture and sets standards for security, governance, and data product development. You will drive end-to-end data architecture, create reusable frameworks, and collaborate with product, engineering, and business stakeholders to shape the data