Databricks Solution Architect - VP, Data & AI

SMBC Group; Charlotte (NC); Hybrid; USD 180,000 - 240,000; Full time

Job summary

SMBC Group seeks a Solution Architect - Vice President to lead Databricks-based data, analytics, reporting, and AI initiatives across the enterprise. The role defines standards, reviews implementations, and guides delivery teams to ensure scalable, secure data solutions.

Collaborate with stakeholders to translate requirements into practical architectures, design robust data pipelines, and drive observability, security, and long-term maintainability. Hybrid work model available.

Qualifications

• Eight or more years of hands-on software development, data engineering, solution architecture, or systems integration experience.
• Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Unity Catalog, Python, and SQL.
• Extensive experience designing and implementing enterprise data pipelines, integration solutions, analytics platforms, and reporting solutions.
• Strong experience developing data ingestion, transformation, orchestration, data quality, and publishing frameworks.
• Deep knowledge of batch processing, streaming architectures, event-driven integrations, and large-scale data processing.
• Experience designing and implementing ETL/ELT architectures and enterprise data integration solutions.
• Experience creating technical specifications, source-to-target mappings, architecture designs, interface specifications, and integration documentation.
• Strong experience using Jira for backlog management, sprint planning, user story development, release coordination, and technical project execution.
• Experience troubleshooting complex data, integration, performance, scalability, and production support issues.
• Ability to review developer code, identify architectural and design issues, and guide teams in resolving challenges.
• Strong understanding of enterprise integration patterns, API architectures, data governance, security controls, and operational support requirements.

Responsibilities

• Define architecture standards, reference patterns, and implementation guidance for Databricks-based data, analytics, reporting, and AI solutions.
• Design and implement integrations between Databricks, ServiceNow, enterprise applications, cloud platforms, APIs, cybersecurity solutions, operational systems, and external data sources.
• Create detailed technical specifications, source-to-target mappings, integration designs, architecture diagrams, interface specifications, and developer-ready implementation requirements.
• Design and oversee enterprise data pipelines supporting ingestion, transformation, enrichment, publishing, analytics, reporting, and operational intelligence workloads.
• Review solution designs to ensure alignment with enterprise architecture principles, security requirements, scalability expectations, operational support requirements, and long-term maintainability.
• Troubleshoot complex data pipeline issues, integration failures, performance bottlenecks, data quality challenges, and production support issues.
• Conduct design reviews and code reviews to promote engineering standards, security requirements, operational resiliency, and maintainability.
• Develop reusable ingestion, transformation, publishing, and integration patterns that support scalable and efficient data delivery.
• Support analytics, reporting, operational intelligence, machine learning, and AI initiatives leveraging enterprise data assets.
• Evaluate new Databricks capabilities, data technologies, AI services, and platform tools to improve engineering capabilities and delivery efficiency.
• Translate business requirements into practical technical solutions while ensuring scalability, supportability, observability, and long-term maintainability.

Skills

Databricks

Apache Spark

Delta Lake

Unity Catalog

Python

SQL

Data pipelines

Data integration

Analytics platforms

Jira

API design

Event-driven

Security controls

Operational support

Data governance

Data lineage

ETL/ELT

Code review

Troubleshooting

ServiceNow

Azure Data Factory

Azure Storage

Azure Functions

Event Hub

Tools

Jira

ServiceNow

Azure Data Factory

Azure Storage

Azure Functions

Event Hub

Job description

SMBC Group seeks a Solution Architect - Vice President to lead Databricks-based data, analytics, reporting, and AI initiatives across the enterprise. The role defines standards, reviews implementations, and guides delivery teams to ensure scalable, secure data solutions.

Collaborate with stakeholders to translate requirements into practical architectures, design robust data pipelines, and drive observability, security, and long-term maintainability. Hybrid work model available.