Senior Data Architect: Azure Lakehouse & Data Platform Lead

HSO; New York (NY); On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Medical, dental & vision coverage

Unlimited paid time off

401(k) plan with company match

Flexible benefits program

Job summary

HSO in New York is seeking a Senior Data Architect to lead complex data modernization initiatives across Azure Synapse, Databricks, and Data Lake architectures. You will design scalable pipelines, migrate on-premises warehouses to lakehouse models, and collaborate with Dynamics 365, Salesforce, SAP, and other platforms to deliver integrated analytics.

You’ll implement governance and security with Azure Purview and Key Vault, build CI/CD pipelines with Azure DevOps and GitHub, and mentor

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• 10+ years of experience in data architecture, ETL, data warehousing, and cloud transformation initiatives.
• Deep expertise with Azure Synapse, Databricks, Spark, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Functions, Python, and SQL/T‑SQL.
• Proven experience optimizing cloud platform cost, performance, scalability, and operational efficiency.
• Strong knowledge of Data Mesh, Delta Lake, Azure Purview, and modern data governance and observability frameworks.

Responsibilities

• Architect, lead, and deliver complex data modernization initiatives leveraging Azure Synapse, Microsoft Fabric, Azure Data Lake, Databricks, and related Azure services.
• Drive on-premises to Azure migration strategies, modernizing legacy data warehouses into scalable lakehouse and Delta Lake architectures.
• Design and implement enterprise data integration frameworks across Dynamics 365 F&O, Dynamics 365 CE, Salesforce, SAP, Workday, and third-party platforms using Azure-native services and Data API Gateways.
• Build, optimize, and maintain advanced data pipelines in Azure Synapse and Azure Data Factory (ADF), supporting both full and incremental data loads from cloud and on-premises environments.
• Establish scalable, cost-efficient, and high-performing data architectures by driving performance optimization and platform best practices across Databricks and Synapse environments.
• Implement enterprise-grade data platform capabilities including Delta Lake features such as CDC, schema evolution, and slowly changing dimensions (SCDs).
• Apply modern governance, security, and observability frameworks using Azure Purview, Key Vault, and Data Mesh principles to ensure trusted and compliant data solutions.
• Lead the design and implementation of reusable CI/CD frameworks using Azure DevOps, GitHub, ARM templates, and PowerShell automation.
• Partner with cross-functional Microsoft service line teams, including Power Platform, Dynamics 365, Azure Infrastructure, and Modern Work, to deliver integrated client solutions.
• Serve as a trusted advisor by contributing to client roadmaps, strategy discussions, proposals, steering committee meetings, and executive communications while ensuring customer satisfaction and delivery excellence.

Skills

Azure Synapse

Databricks

Azure Data Lake

Azure Data Factory

Python

SQL/T-SQL

CI/CD

Azure DevOps

GitHub Actions

PowerShell

ARM templates

Education

Bachelor's degree in Computer Science, Information Technology, or related field

Tools

Azure DevOps

GitHub

ARM templates

Job description

HSO in New York is seeking a Senior Data Architect to lead complex data modernization initiatives across Azure Synapse, Databricks, and Data Lake architectures. You will design scalable pipelines, migrate on-premises warehouses to lakehouse models, and collaborate with Dynamics 365, Salesforce, SAP, and other platforms to deliver integrated analytics.

You’ll implement governance and security with Azure Purview and Key Vault, build CI/CD pipelines with Azure DevOps and GitHub, and mentor