Databricks Solutions Architect

Compunnel, Inc.; Town of Florida (NY); On-site; USD 120,000 - 160,000; Full time

Job summary

A leading technology solution provider seeks a Solution Architect with expertise in Databricks to lead enterprise data platform design and modernization. The successful candidate will have 8+ years in data architecture, with strong skills in Delta Lake and cloud platforms like AWS and Azure. Responsibilities include designing scalable solutions, overseeing data governance, and supporting pre-sales activities. This role offers a unique opportunity to shape data architectures while collaborating with cross-functional teams.

Qualifications

• 8+ years of experience in data engineering and architecture.
• 4+ years of experience designing Databricks-based solutions.
• Strong expertise in Delta Lake architecture and performance optimization.

Responsibilities

• Lead end-to-end solution architecture for Databricks-based data platforms.
• Design scalable ingestion frameworks for batch and streaming data.
• Conduct architecture workshops and technical design sessions.

Skills

Data engineering and architecture

Databricks implementation

Delta Lake architecture

SQL proficiency

Client-facing skills

Education

Bachelor’s degree in Computer Science or Information Systems

Tools

Databricks

Kafka

Azure

AWS

Job description

We are seeking a Solution Architect with strong expertise in Databricks to lead the design and modernization of enterprise data platforms.

This role serves as the primary architectural authority, responsible for translating business requirements into scalable, secure, and high-performing lakehouse solutions.

The ideal candidate will have deep experience in data architecture, cloud platforms, and Databricks implementation, along with strong client-facing and consulting skills.

Key Responsibilities

• Lead end-to-end solution architecture for Databricks-based data platforms
• Design scalable ingestion frameworks for batch and streaming data aligned with enterprise requirements
• Architect and implement Medallion lakehouse patterns ensuring proper data layer separation
• Define Delta Lake architecture standards including schema evolution, partitioning, and performance optimization
• Provide oversight for semantic modeling aligned with reporting and analytics requirements
• Design environment strategies including development, testing, and production models
• Establish governance frameworks including data security, access control, and data lineage
• Conduct architecture workshops, technical design sessions, and stakeholder reviews
• Define integration patterns with upstream systems, APIs, and enterprise data sources
• Collaborate with engineering teams to ensure proper implementation of architectural standards
• Identify scalability and performance risks and provide mitigation strategies
• Contribute to platform modernization strategies and roadmap planning
• Support pre-sales activities including solution design, scoping, and technical discovery

Required Qualifications

• 8+ years of experience in data engineering and architecture
• 4+ years of experience designing and implementing Databricks-based solutions
• Strong expertise in Delta Lake architecture and performance optimization
• Deep understanding of Medallion lakehouse architecture patterns
• Advanced proficiency in SQL and working knowledge of PySpark
• Experience designing scalable ingestion and transformation frameworks
• Experience implementing enterprise data governance and access control frameworks
• Experience designing semantic models aligned with BI and reporting needs
• Strong communication, presentation, and client-facing consulting skills
• Experience leading architecture design sessions and governance reviews
• Bachelor’s degree in Computer Science, Information Systems, or equivalent experience

Preferred Qualifications

• Databricks certifications
• Experience with streaming technologies such as Kafka, Event Hubs, or Delta Live Tables
• Experience with cloud platforms such as AWS or Azure
• Experience in large-scale data platform modernization or migration initiatives