Databricks Solution Architect

INSPYR Solutions; Pasadena (CA); On-site; USD 165,000 - 248,000; Full time

Job summary

INSPYR Solutions is seeking an experienced Databricks Solutions Architect to lead design, architecture, and modernization of an enterprise data platform. You will guide secure, governed Databricks implementations, mentor teams, and establish architecture standards across on-prem and cloud environments.

The ideal candidate has hands-on experience with Delta Lake, Unity Catalog, Lakeflow, and AI/ML capabilities, and a track record of migrating legacy data environments to lakehouse architectures.

Qualifications

• 7+ years designing, building, and operating enterprise Databricks environments.
• Hands-on experience with Delta Lake, Unity Catalog, Spark, and Databricks tools.
• Experience migrating enterprise data platforms to Databricks.
• Strong cloud architecture and security knowledge (AWS/Azure).
• Ability to mentor engineers and lead architectural reviews.
• Excellent communication and stakeholder management.

Responsibilities

• Serve as technical advisor for Databricks reference architecture.
• Design end-to-end Databricks data platform solutions.
• Architect batch and real-time streaming pipelines.
• Lead migrations from legacy systems to Databricks.
• Establish secure, governed architectures and policy compliance.
• Mentor data teams and participate in architecture reviews.
• Evaluate new Databricks capabilities and adoption strategies.

Skills

Databricks

Python

SQL

Apache Spark

Cloud architecture

Governance

Stakeholder management

Education

Bachelor's degree in a relevant field

Tools

Delta Lake

Unity Catalog

Lakeflow

Databricks SQL

MLflow

Mosaic AI

Job description

Databricks Solutions Architect

Location: TBD
Job Type: Contract

Position Overview
Our client is seeking an experienced Databricks Solutions Architect to lead the design, architecture, and modernization of its enterprise data platform. This role provides technical leadership for scalable, secure, and governed Databricks solutions, mentors engineering teams, and helps establish architecture standards.

The ideal candidate has extensive hands‑on experience designing enterprise-scale Databricks platforms, migrating legacy data environments, and implementing modern lakehouse architectures using Delta Lake, Unity Catalog, Lakeflow, and AI/ML capabilities.

Key Responsibilities

• Serve as technical advisor for Databricks reference architecture, including Lakeflow, Delta Lake, Unity Catalog, Mosaic AI, Databricks SQL, and Databricks Apps
• Design and provide hands‑on guidance for end‑to‑end Databricks data platform solutions
• Architect batch and real‑time streaming pipelines, including zero‑copy data sharing patterns
• Lead migrations from legacy SQL databases, data warehouses, and document stores to Databricks and cloud data platforms
• Design secure, governed architectures using Unity Catalog, ABAC, governed tags, row‑and column‑level security, encryption, key management, networking, and compliance frameworks
• Develop multi‑tier data lake architectures aligned with data classification and regulatory requirements
• Establish FinOps best practices for workload optimization, performance tuning, and cost management
• Mentor data engineers, analysts, and AI/ML teams; participate in architecture reviews and define technical standards
• Partner with security, infrastructure, and governance teams to ensure policy compliance
• Evaluate emerging Databricks capabilities and recommend adoption strategies and platform enhancements

Required Qualifications

• 7+ years designing, building, and operating enterprise Databricks environments using Medallion Architecture
• Extensive hands‑on experience with Delta Lake, Unity Catalog, Spark Structured Streaming, Lakeflow (or Delta Live Tables), Databricks SQL, MLflow, and Mosaic AI Model Serving
• Strong cloud architecture experience supporting Databricks on AWS (S3, KMS, VPC) and/or Azure (ADLS, VNet), including cloud networking and security
• Proven success migrating enterprise data platforms from legacy or on‑prem environments to Databricks
• Experience designing and supporting production streaming and Change Data Capture (CDC) solutions
• Deep understanding of data governance, security, and compliance: Unity Catalog policies (ABAC), data classification, encryption, access auditing, and regulatory compliance
• Experience designing multi‑tier Databricks environments based on data classification
• Strong skills in Python, SQL, Apache Spark, and Databricks Notebooks
• Excellent communication, presentation, and stakeholder management skills

Preferred Qualifications

• Active Databricks certifications
• Experience with Generative AI and AI agent development on Databricks
• Knowledge of Delta Sharing, Databricks Clean Rooms, and governed cross‑organizational data sharing
• Experience integrating Databricks with major ERP platforms and their native data services, including zero‑copy integration patterns
• Experience with Lakeflow Designer, Databricks Apps, Genie, and Databricks One
• CI/CD and Infrastructure-as-Code (Terraform) for data platforms
• Background designing enterprise BI reporting solutions
• Experience with Data Quality and Data Governance initiatives
• Experience in highly regulated industries (e.g., financial services, healthcare, life sciences, energy, or public sector) and associated compliance frameworks

About INSPYR Solutions

Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.

INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, or any other protected status. INSPYR Solutions complies with all applicable laws governing nondiscrimination in employment in every location in which the company has facilities. Applicants requiring reasonable accommodation during the application or interview process should contact [e-mail] for assistance. Information collected and processed through your application with INSPYR Solutions (including any job applications you choose to submit) is subject to INSPYR Solutions' Privacy Policy and INSPYR Solutions' AI and Automated Employment Decision Tool Policy: https://www.inspyrsolutions.com/policies/. By submitting an application, you are consenting to being contacted by INSPYR Solutions through phone, email, or text.

26-159575