Azure Databricks Architect - Fulltime

Acunor Inc; New York (NY); Remote; USD 170,000 - 260,000; Full time

Job summary

Acunor Inc. is seeking a Lead Architect Azure & Databricks to design and govern end-to-end data and analytics platforms on Azure and Databricks. You will lead architecture discussions, define lakehouse and data mesh patterns, and ensure scalable, secure solutions aligned with enterprise standards.

The role emphasizes hands-on leadership, mentorship of engineering teams, and collaboration with clients on proposals and estimates to drive modernization initiatives.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• 10+ years of experience in Data Engineering, Cloud Architecture, or Solution Architecture.
• 5+ years of hands-on experience with Azure cloud services.
• 4+ years of hands-on experience with Databricks and Spark-based solutions.
• Demonstrated experience designing enterprise-scale data platforms.
• Experience working with large-scale structured and unstructured datasets.
• Strong stakeholder management and client-facing communication skills.

Responsibilities

• Architect end-to-end data and analytics solutions on Azure and Databricks.
• Design scalable platforms supporting batch, streaming, and real-time analytics.
• Lead solution design discussions, architecture reviews, and governance.
• Define data lake, data warehouse, lakehouse, and data mesh architectures.
• Translate business requirements into practical technical solutions.
• Establish platform security, governance, and compliance standards.
• Design data integration frameworks using Azure-native services and Databricks.
• Drive performance optimization, cloud cost management, and modernization initiatives.
• Provide technical leadership and mentor engineering teams.
• Support proposal development, effort estimation, and client presentations.
• Ensure alignment with enterprise architecture standards and best practices.

Skills

Azure

Databricks

Data Engineering

DevOps

Automation

Terraform

Education

Bachelor's or Master's degree

Tools

Terraform

Job description

Lead Architect Azure & Databricks

Location

100% Remote

Working Hours

EST

Employment Type

Full-Time

Work Authorization

Visa-independent candidates only.

Key Responsibilities

• Architect end-to-end data and analytics solutions on Azure and Databricks.
• Design scalable platforms supporting batch, streaming, and real-time analytics.
• Lead solution design discussions, architecture reviews, and technical governance.
• Define data lake, data warehouse, lakehouse, and data mesh architectures.
• Translate business requirements into practical technical solutions.
• Establish platform security, governance, and compliance standards.
• Design data integration frameworks using Azure-native services and Databricks.
• Drive performance optimization, cloud cost management, and modernization initiatives.
• Provide technical leadership and mentor engineering teams.
• Support proposal development, effort estimation, and client presentations.
• Ensure alignment with enterprise architecture standards and best practices.

Required Technical Skills

• Azure: Azure Data Factory, Azure Databricks, ADLS Gen2, Azure Synapse Analytics, Azure SQL Database, Azure Event Hub, Azure Service Bus, Azure Functions, Azure Key Vault, Azure Monitor, and Microsoft Entra ID.
• Databricks: Lakehouse Architecture, Delta Lake, Unity Catalog, Databricks Workflows, Structured Streaming, Medallion Architecture, cluster optimization, and performance tuning.
• Data Engineering: Python, PySpark, SQL, data modeling, ETL/ELT frameworks, data warehousing, and real-time data processing.
• DevOps and Automation: Azure DevOps, CI/CD pipelines, Git, and Infrastructure as Code. Terraform is preferred.

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• 10+ years of experience in Data Engineering, Cloud Architecture, or Solution Architecture.
• 5+ years of hands-on experience with Azure cloud services.
• 4+ years of hands-on experience with Databricks and Spark-based solutions.
• Demonstrated experience designing enterprise-scale data platforms.
• Experience working with large-scale structured and unstructured datasets.
• Strong stakeholder management and client-facing communication skills.