Senior Solutions Architect (Databricks Specialist)

Blue Pearl; United States; On-site; USD 170,000 - 210,000; Full time

Job summary

Blue Pearl is seeking an experienced Senior Solutions Architect focused on Databricks to lead a large-scale data modernization program within the financial services domain. The role will define target-state architecture, governance, and migration strategies from SQL Server and Microsoft-centric platforms to a Databricks-based ecosystem.

You will guide enterprise data platforms, drive cost-efficient design, and ensure alignment with AI strategies and regulatory requirements while mentoring

Qualifications

• 10+ years in Solution/Enterprise/Data Architecture roles.
• Large-scale data transformation and modernization experience.
• Extensive Databricks implementation in enterprise environments.
• Cloud migration and modern data platform programs.
• Experience in Financial Services or regulated environments.
• Knowledge of governance, security, and risk frameworks.
• Standards, frameworks, and governance model development.

Responsibilities

• Provide strategic architectural leadership for Databricks implementation and data modernization initiatives.
• Design enterprise-scale data and analytics architectures aligned to business and AI objectives.
• Develop and implement architectural frameworks, standards, patterns, and best practices for Databricks adoption.
• Guide Data Engineering teams on solution design, scalability, security, and governance.
• Assess SQL Server and Microsoft-based environments; define migration strategies to Databricks.
• Ensure architecture decisions support AI, ML, analytics, and reporting needs.
• Evaluate platform utilization to optimize costs and ROI.
• Establish governance, architecture review processes, and roadmaps.
• Provide executive-level insights on technology direction, risks, and investments.
• Collaborate with stakeholders, leadership, engineering, and vendors for outcomes.
• Oversee solution quality and alignment with enterprise architecture and regulatory requirements.
• Identify risks and mitigations; mentor engineering teams.

Skills

Databricks

Enterprise data platforms

Lakehouse architecture

Governance & security

Data migration

Enterprise integration

Analytics & AI/ML enablement

Tools

Azure Data Factory

Azure Synapse Analytics

SQL Server

Delta Lake

Unity Catalog

DataOps/DevOps

Job description

Category: IT Services Location: We are seeking an experienced Senior Solutions Architect specializing in Databricks to provide strategic leadership and architectural oversight for a large-scale data modernization program within a leading Financial Services organization. The client is currently transitioning from a traditional SQL Server and Microsoft-centric data ecosystem to a modern Databricks-based platform to support its long-term data, analytics, and AI strategy. While the client has an established and capable Data Engineering team, they require a senior-level architect to provide strategic direction, implementation frameworks, architectural governance, and best-practice guidance to ensure a successful and cost-effective transformation.

• This role will focus on defining the target-state architecture, establishing standards and governance, optimizing platform design, and ensuring alignment between technology investments and business objectives.

Key Responsibilities

• Provide strategic architectural leadership for the organisation's Databricks implementation and data modernization initiatives.
• Design and define enterprise-scale data and analytics architectures aligned to business and AI objectives.
• Develop and implement architectural frameworks, standards, patterns, and best practices for Databricks adoption.
• Guide the Data Engineering team on solution design, scalability, performance optimization, security, and governance.
• Assess current SQL Server and Microsoft-based environments and define migration strategies to Databricks.
• Ensure architecture decisions support future AI, machine learning, advanced analytics, and reporting requirements.
• Evaluate and optimize platform utilization to drive cost efficiency and maximize return on investment.
• Establish governance, architecture review processes, and implementation roadmaps.
• Provide executive-level insights and recommendations on technology direction, risks, opportunities, and investments.
• Collaborate with business stakeholders, technology leadership, engineering teams, and vendors to drive successful outcomes.
• Oversee solution quality and ensure alignment with enterprise architecture principles and regulatory requirements.
• Identify technical risks, dependencies, and potential challenges, implementing mitigation strategies where required.
• Mentor engineering teams and promote architectural excellence across the program.

Requirements Required Technical Skills Essential

• Deep expertise in Databricks architecture, implementation, and optimization
• Strong understanding of enterprise data platforms and modern data architectures
• Data Lakehouse architecture design and implementation
• Data governance, security, compliance, and data management frameworks
• Data migration strategy and execution
• Enterprise integration patterns and cloud-based architectures
• Analytics, Business Intelligence, and AI/ML platform enablement

Preferred

• Experience with Microsoft Azure Data Services
• Azure Data Factory
• Azure Synapse Analytics
• SQL Server
• Delta Lake
• Unity Catalog
• DataOps and DevOps practices
• AI and Machine Learning platform architecture

Essential Experience & Qualifications

• 10+ years of experience in Solution Architecture, Enterprise Architecture, or Data Architecture roles.
• Demonstrated experience delivering large-scale data transformation and modernization initiatives.
• Extensive experience designing and implementing Databricks solutions in enterprise environments.
• Proven track record supporting cloud migration and modern data platform programs.
• Experience within Financial Services, Banking, Insurance, or highly regulated environments.
• Strong understanding of data governance, security, compliance, and risk management frameworks.
• Experience developing enterprise architecture standards, frameworks, and governance models.
• Relevant certifications in Databricks, Cloud Platforms (Azure preferred), TOGAF, or related disciplines are highly advantageous.

Key Competencies

Strategic Leadership

• Ability to align technology architecture with long-term business strategy.
• Strong commercial acumen and focus on value delivery.
• Ability to influence technology direction at executive level.

Stakeholder Engagement

• Comfortable engaging with C-suite executives and senior business leaders.
• Strong communication, presentation, and facilitation skills.
• Ability to simplify complex technical concepts for non-technical audiences.

Architecture & Governance

• Excellent architectural design and decision-making capabilities.
• Strong focus on governance, standards, and best practices.
• Ability to drive consistency across multiple teams and initiatives.

Delivery & Outcomes

• Results-driven with a focus on business impact and measurable outcomes.
• Strong problem-solving and analytical thinking skills.
• Ability to work independently while guiding large technical teams.

Ideal Candidate Profile

The ideal candidate is a highly experienced Senior Solutions Architect with deep Databricks expertise , capable of providing strategic oversight to an established engineering team. They will bring extensive experience in enterprise data transformation, architecture governance, and cloud-based analytics platforms. The successful individual will be comfortable operating at executive level, influencing business and technology strategy, while ensuring Databricks is implemented in a scalable, cost-effective, and future-ready manner that supports the organisation's AI and data ambitions.