Senior Databricks Architect - Cloud Lakehouse Leader

Capstone IT, Inc.; Kansas City (MO); Vor Ort; USD 150.000 - 210.000; Vollzeit

Zusammenfassung

Capstone IT is helping our client to find a Senior Data Architect - Databricks who will lead the design, implementation, and modernization of enterprise data platforms using Databricks and cloud technologies.

This role requires hands-on engineering leadership, architecture ownership, and a track record of complete Databricks implementations, including governance, security, and cost optimization across cloud providers.

Qualifikationen

• 8+ years in data architecture, engineering, or warehousing.
• Databricks experience with at least one complete implementation.
• Advanced Python, PySpark, and SQL skills; cloud data lakehouse design.
• Experience with Unity Catalog, governance, security, and data quality.
• Leadership in architecture ownership and mentoring engineering teams.

Aufgaben

• Architect and deploy enterprise Databricks Lakehouse platforms from the ground up.
• Lead environment configuration, data integration, migration, testing, and production deployment.
• Design data pipelines using Python, PySpark, SQL, Apache Spark, and Delta Lake.
• Implement Bronze, Silver, and Gold data layers.
• Establish governance and security using Unity Catalog.
• Modernize legacy data warehouses and ETL platforms.
• Optimize compute performance, scalability, reliability, and cloud costs.
• Implement CI/CD pipelines and infrastructure automation.
• Develop architecture diagrams, standards, and technical roadmaps.
• Provide hands‑on technical leadership to engineering, DevOps, analytics, and BI teams.

Kenntnisse

Databricks Architecture

End-to-End Implementation

Cloud Data Architecture

Lakehouse Design

Unity Catalog Governance

Technical Leadership

Tools

Terraform

CI/CD

Azure Data Factory

AWS Glue

dbt

Airflow

Power BI

Tableau

Jobbeschreibung

Capstone IT is helping our client to find a Senior Data Architect - Databricks who will lead the design, implementation, and modernization of enterprise data platforms using Databricks and cloud technologies.

This role requires hands-on engineering leadership, architecture ownership, and a track record of complete Databricks implementations, including governance, security, and cost optimization across cloud providers.