Senior Databricks Lakehouse Architect

Astir IT Solutions, Inc.; King of Prussia (PA); On-site; USD 150,000 - 190,000; Full time

Job summary

Astir IT Solutions, Inc. seeks an experienced Databricks Solution Architect to design and lead enterprise-scale data and AI solutions using the Databricks platform. The role emphasizes Lakehouse architecture, governance, and secure, scalable implementations.

The ideal candidate brings hands-on Databricks expertise, cloud experience (AWS/Azure/GCP), and strong collaboration with stakeholders to translate requirements into architecture options and roadmaps.

Qualifications

• 12+ years of experience in Data Engineering, Data Architecture, Cloud Architecture, or related fields.
• 5+ years of strong Databricks experience, including architecture and implementation.
• Hands-on experience with Databricks Lakehouse Platform, Unity Catalog, Databricks SQL, and Databricks Workflows/Jobs.
• Strong programming experience with Python and/or Scala; strong SQL development and performance-tuning skills.
• Experience designing enterprise-scale batch and real-time data pipelines; knowledge of data governance and security.

Responsibilities

• Design and implement enterprise-grade Databricks Lakehouse architectures across development, testing, and production environments.
• Define target-state architecture for data engineering, analytics, BI, ML, and AI workloads.
• Architect solutions using Databricks, Delta Lake, Apache Spark, Unity Catalog, Databricks SQL, Workflows/Jobs, and Lakehouse Federation.
• Design and implement enterprise data governance, security, access control, lineage, and data-sharing strategies using Unity Catalog.
• Lead migration of legacy data platforms, data warehouses, and Hive Metastore to Databricks/Unity Catalog.
• Develop scalable data ingestion and processing architectures for batch and streaming workloads.
• Provide technical leadership for performance tuning, scalability, reliability, and cost optimization of Databricks environments.
• Collaborate with DevOps to implement automated deployment pipelines and IaC.

Skills

Databricks Lakehouse Platform

Unity Catalog

Databricks SQL

Databricks Workflows/Jobs

Python

Scala

SQL tuning

Data governance and security

Cloud architecture

Architectural leadership

Tools

Terraform

CI/CD

Informatica

dbt

Power BI

Tableau

Job description

Astir IT Solutions, Inc. seeks an experienced Databricks Solution Architect to design and lead enterprise-scale data and AI solutions using the Databricks platform. The role emphasizes Lakehouse architecture, governance, and secure, scalable implementations.

The ideal candidate brings hands-on Databricks expertise, cloud experience (AWS/Azure/GCP), and strong collaboration with stakeholders to translate requirements into architecture options and roadmaps.