Senior Databricks Lakehouse Architect

Q1 Technologies, Inc.; Malvern (Chester County); On-site; USD 140,000 - 190,000; Full time

Job summary

Q1 Technologies, Inc. in Malvern, PA is seeking a Senior Databricks Architect with 14+ years of experience to design and implement enterprise-scale Lakehouse architectures on cloud platforms.

You will lead data strategy, governance, and scalable analytics platforms supporting AI/ML and BI initiatives. The role focuses on Databricks, Spark, PySpark, Delta Lake, and real-time data processing, with strong emphasis on security, governance, and cloud migration strategy.

Qualifications

• Experience with dimensional modeling (star/snowflake) and data warehouse design.
• Proven data lake architecture experience (S3, Lake Formation, best practices).
• Big data processing with Spark/PySpark; EMR familiarity is a plus.
• Advanced SQL skills, query tuning and performance optimization.
• Experience with real-time streaming (Kinesis and/or Kafka).
• Security & governance skills (IAM, KMS, encryption, governance).
• Infrastructure as Code using Terraform and/or CloudFormation.
• Ability to design solutions and translate business requirements into data architectures.
• Leadership experience guiding cross-functional teams on cloud migrations.

Responsibilities

• Design and implement enterprise-scale Lakehouse architectures on cloud platforms (Databricks, Spark).
• Define data strategy, architecture standards, governance, and scalable analytics platforms for AI/ML and BI initiatives.
• Lead stakeholder discussions, translate requirements, and drive delivery of data engineering projects.

Skills

Data Modeling

Data Warehouse

Data Lake Architecture

Spark PySpark

SQL Optimization

Streaming Real-Time

Security & Governance

IaC Terraform/CF

Architecture Leadership

Job description

Q1 Technologies, Inc. in Malvern, PA is seeking a Senior Databricks Architect with 14+ years of experience to design and implement enterprise-scale Lakehouse architectures on cloud platforms.

You will lead data strategy, governance, and scalable analytics platforms supporting AI/ML and BI initiatives. The role focuses on Databricks, Spark, PySpark, Delta Lake, and real-time data processing, with strong emphasis on security, governance, and cloud migration strategy.